b4rtaz/distributed-llama

Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

Language: C++ - Size: 3.23 MB - Last synced at: 5 days ago - Pushed at: 23 days ago - Stars: 2,056 - Forks: 147