Topic: "exllama"
gotzmann/booster
Booster - open accelerator for LLM models. Better inference and debugging for AI hackers
Language: C++ - Size: 144 MB - Last synced at: 6 days ago - Pushed at: 9 months ago - Stars: 155 - Forks: 7
innightwolfsleep/llm_telegram_bot
LLM telegram bot
Language: Python - Size: 1.15 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 120 - Forks: 24
c0sogi/llama-api
An OpenAI-like LLaMA inference API
Language: Python - Size: 664 KB - Last synced at: 6 days ago - Pushed at: over 1 year ago - Stars: 112 - Forks: 9
shinomakoi/magi_llm_gui
A Qt GUI for large language models
Language: Python - Size: 645 KB - Last synced at: 6 days ago - Pushed at: over 1 year ago - Stars: 42 - Forks: 3
shinomakoi/AI-Messenger
A QT GUI for large language models
Language: Python - Size: 231 KB - Last synced at: 6 days ago - Pushed at: over 1 year ago - Stars: 33 - Forks: 6
silphendio/sliced_llama
Simple LLM inference server
Language: Python - Size: 1.38 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 15 - Forks: 0
NO-ob/simpleLlama
A Simple webserver for generating text with exllamav2
Language: Python - Size: 48.8 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 14 - Forks: 2
seyf1elislam/LocalLLM_OneClick_Colab
Run gguf LLM models in Latest Version TextGen-webui
Language: Jupyter Notebook - Size: 102 KB - Last synced at: 4 days ago - Pushed at: 7 months ago - Stars: 10 - Forks: 0
Aqirito/A.L.I.C.E
A.L.I.C.E (Artificial Labile Intelligence Cybernated Existence). A REST API of A.I companion for creating more complex system
Language: Python - Size: 22.2 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 7 - Forks: 0
kooten111/EasyEXL
A Python script designed to streamline the process of quantizing models to exllamav2 format
Language: Python - Size: 36.1 KB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 2
countzero/windows_exllama
This is a playground to explore the ExLlama project in a Windows environment.
Language: PowerShell - Size: 14.6 KB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0
