Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: intel-optimized-llamacpp

intel/intel-extension-for-transformers

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

Language: Python - Size: 543 MB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 1,909 - Forks: 180

Related Keywords
4-bits 1 chatbot 1 chatpdf 1 cpu 1 gaudi2 1 gpu 1 habana 1 intel-optimized-llamacpp 1 large-language-model 1 llm-cpu 1 llm-inference 1 neural-chat 1 neural-chat-7b 1 neurips2023 1 rag 1 retrieval 1 speculative-decoding 1 streamingllm 1 xeon 1