GitHub / Lizonghang / prima.cpp
prima.cpp: Speeding up 70B-scale LLM inference on low-resource everyday home clusters
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Lizonghang%2Fprima.cpp
Stars: 576
Forks: 30
Open issues: 5
License: mit
Language: C++
Size: 45.8 MB
Dependencies parsed at: Pending
Created at: 6 months ago
Updated at: 4 days ago
Pushed at: 5 days ago
Last synced at: 4 days ago
Topics: distributed-ai, distributed-inference, llama-cpp, llm-inference, on-device-llms
Loading...