InftyAI/karpenter Fork of kubernetes-sigs/karpenter

This is a fork of Karpenter focused on GPU scaling with llmaz.

Language: Go - Size: 6.03 MB - Last synced at: about 1 hour ago - Pushed at: about 14 hours ago - Stars: 0 - Forks: 1

InftyAI/llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

Language: Go - Size: 10.9 MB - Last synced at: 3 days ago - Pushed at: 9 days ago - Stars: 179 - Forks: 29

InftyAI/Awesome-LLMOps

🎉 An awesome & curated list of best LLMOps tools.

Language: Python - Size: 6.8 MB - Last synced at: 2 days ago - Pushed at: 5 days ago - Stars: 109 - Forks: 23

InftyAI/scheduler-plugins

Scheduler plugins designed for smart scheduling with llmaz.

Language: Go - Size: 201 KB - Last synced at: about 17 hours ago - Pushed at: 6 days ago - Stars: 8 - Forks: 2

InftyAI/website

Website and Blogs.

Language: HTML - Size: 425 KB - Last synced at: 7 days ago - Pushed at: 20 days ago - Stars: 1 - Forks: 1

InftyAI/Manta

💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯

Language: Go - Size: 811 KB - Last synced at: about 17 hours ago - Pushed at: 6 months ago - Stars: 23 - Forks: 3

InftyAI/community

The InftyAI community.

Size: 13.7 KB - Last synced at: 7 days ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 1

InftyAI/llmlite

🌵 A library helps to communicate with all kinds of LLMs consistently.

Language: Python - Size: 246 KB - Last synced at: about 17 hours ago - Pushed at: 11 months ago - Stars: 18 - Forks: 3

InftyAI/template-repo

A template repo.

Size: 15.6 KB - Last synced at: about 17 hours ago - Pushed at: 3 months ago - Stars: 0 - Forks: 1

InftyAI/PR-Copilot

Your AI pair programmer 🤖️ specialized in code review, code summary and even code completion. 🧑‍💻🐛

Language: Python - Size: 157 KB - Last synced at: about 17 hours ago - Pushed at: 11 months ago - Stars: 3 - Forks: 3

InftyAI/.github

Size: 20.5 KB - Last synced at: 7 days ago - Pushed at: 4 months ago - Stars: 0 - Forks: 1

InftyAI/omnistore

🎯 An unified python client to communicate with various kinds of object-store providers.

Language: Python - Size: 39.1 KB - Last synced at: about 17 hours ago - Pushed at: 7 months ago - Stars: 2 - Forks: 2