Topic: "cpu-inference"
kennethleungty/Llama-2-Open-Source-LLM-CPU-Inference
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
Language: Python - Size: 4.52 MB - Last synced at: 10 days ago - Pushed at: over 1 year ago - Stars: 961 - Forks: 211
CoderLSF/fast-llama
Runs LLaMA with Extremely HIGH speed
Language: C++ - Size: 252 KB - Last synced at: 7 days ago - Pushed at: over 1 year ago - Stars: 89 - Forks: 10
rbitr/llm.f90
LLM inference in Fortran
Language: Fortran - Size: 1.65 MB - Last synced at: 7 days ago - Pushed at: about 1 year ago - Stars: 57 - Forks: 4
jozsefszalma/homelab
The bare metal in my basement
Size: 54.9 MB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 10 - Forks: 2
yybit/pllm
Portable LLM - A rust library for LLM inference
Language: Rust - Size: 266 KB - Last synced at: 7 days ago - Pushed at: about 1 year ago - Stars: 9 - Forks: 1
laelhalawani/gguf_llama
Wrapper for simplified use of Llama2 GGUF quantized models.
Language: Python - Size: 48.8 KB - Last synced at: 7 days ago - Pushed at: over 1 year ago - Stars: 6 - Forks: 2
JohnClaw/chatllm.v
V-lang api wrapper for llm-inference chatllm.cpp
Language: C - Size: 804 KB - Last synced at: about 2 months ago - Pushed at: 7 months ago - Stars: 5 - Forks: 0
codito/arey
Simple large language model playground app
Language: Python - Size: 7.97 MB - Last synced at: 7 days ago - Pushed at: 8 months ago - Stars: 5 - Forks: 0
JohnClaw/chatllm.vb
VB.NET api wrapper for llm-inference chatllm.cpp
Language: Visual Basic .NET - Size: 6.84 KB - Last synced at: about 2 months ago - Pushed at: 6 months ago - Stars: 4 - Forks: 0
JohnClaw/chatllm.cs
C# api wrapper for llm-inference chatllm.cpp
Language: C# - Size: 779 KB - Last synced at: about 2 months ago - Pushed at: 7 months ago - Stars: 3 - Forks: 0
JohnClaw/chatllm.nim
Nim api-wrapper for llm-inference chatllm.cpp
Language: C - Size: 783 KB - Last synced at: about 2 months ago - Pushed at: 7 months ago - Stars: 3 - Forks: 0
chinese-soup/cbot-telegram-whisper
Simple bot that transcribes Telegram voice messages. Powered by go-telegram-bot-api & whisper.cpp Go bindings.
Language: Go - Size: 12.7 KB - Last synced at: 6 days ago - Pushed at: about 2 years ago - Stars: 2 - Forks: 0
JohnClaw/chatllm.rs
rust api wrapper for llm-inference chatllm.cpp
Language: Rust - Size: 784 KB - Last synced at: 3 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0
JohnClaw/chatllm.lua
lua api wrapper for llm-inference chatllm.cpp
Language: Lua - Size: 791 KB - Last synced at: 3 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0
JohnClaw/chatllm.kt
kotlin api wrapper for llm-inference chatllm.cpp
Language: C - Size: 785 KB - Last synced at: 3 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0
JohnClaw/chatllm.d
D-lang api wrapper for llm-inference chatllm.cpp
Language: D - Size: 785 KB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0