GitHub / bentoml / OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bentoml%2FOpenLLM
PURL: pkg:github/bentoml/OpenLLM
Stars: 11,615
Forks: 754
Open issues: 6
License: apache-2.0
Language: Python
Size: 41.1 MB
Dependencies parsed at: Pending
Created at: over 2 years ago
Updated at: 7 days ago
Pushed at: 12 days ago
Last synced at: 7 days ago
Commit Stats
Commits: 1808
Authors: 35
Mean commits per author: 51.66
Development Distribution Score: 0.322
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/bentoml/OpenLLM
Topics: bentoml, fine-tuning, llama, llama2, llama3-1, llama3-2, llama3-2-vision, llm, llm-inference, llm-ops, llm-serving, llmops, mistral, mlops, model-inference, open-source-llm, openllm, vicuna