GitHub / intel-analytics / ipex-llm

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max). A PyTorch LLM library that seamlessly integrates with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, DeepSpeed, vLLM, FastChat, etc.

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/intel-analytics%2Fipex-llm

Commit Stats

Commits: 18964
Authors: 206
Mean commits per author: 92.06
Development Distribution Score: 0.9
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/intel-analytics/ipex-llm

Topics: gpu, llm, pytorch, transformers

Files

No dependencies found