InftyAI/Awesome-LLMOps

🎉 An awesome & curated list of best LLMOps tools.

Language: Python - Size: 6.22 MB - Last synced at: about 15 hours ago - Pushed at: 4 days ago - Stars: 93 - Forks: 17

InftyAI/llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

Language: Go - Size: 8.71 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 153 - Forks: 25

InftyAI/Manta

💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯

Language: Go - Size: 811 KB - Last synced at: 7 days ago - Pushed at: 5 months ago - Stars: 22 - Forks: 2

InftyAI/website

Website and Blogs.

Language: HTML - Size: 349 KB - Last synced at: 6 days ago - Pushed at: 10 days ago - Stars: 1 - Forks: 1

InftyAI/scheduler-plugins

Scheduler plugins designed for smart scheduling with llmaz.

Language: Go - Size: 153 KB - Last synced at: 7 days ago - Pushed at: 13 days ago - Stars: 5 - Forks: 1

InftyAI/llmaz-dashboard

ChatUI for LLMs on llmaz.

Language: Python - Size: 503 KB - Last synced at: 6 days ago - Pushed at: 3 months ago - Stars: 3 - Forks: 5

InftyAI/community

The InftyAI community.

Size: 13.7 KB - Last synced at: 6 days ago - Pushed at: 16 days ago - Stars: 0 - Forks: 1

InftyAI/llmlite

🌵 A library helps to communicate with all kinds of LLMs consistently.

Language: Python - Size: 246 KB - Last synced at: 7 days ago - Pushed at: 10 months ago - Stars: 18 - Forks: 2

InftyAI/template-repo

A template repo.

Size: 15.6 KB - Last synced at: 6 days ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 1

InftyAI/PR-Copilot

Your AI pair programmer 🤖️ specialized in code review, code summary and even code completion. 🧑‍💻🐛

Language: Python - Size: 157 KB - Last synced at: 7 days ago - Pushed at: 10 months ago - Stars: 3 - Forks: 3

InftyAI/.github

Size: 20.5 KB - Last synced at: 6 days ago - Pushed at: 3 months ago - Stars: 0 - Forks: 1

InftyAI/omnistore

🎯 An unified python client to communicate with various kinds of object-store providers.

Language: Python - Size: 39.1 KB - Last synced at: 7 days ago - Pushed at: 6 months ago - Stars: 2 - Forks: 2