GitHub / ServerlessLLM / ServerlessLLM
Serverless LLM Serving for Everyone.
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ServerlessLLM%2FServerlessLLM
Stars: 465
Forks: 42
Open issues: 34
License: apache-2.0
Language: Python
Size: 3.57 MB
Dependencies parsed at: Pending
Created at: over 1 year ago
Updated at: 4 days ago
Pushed at: 17 days ago
Last synced at: 4 days ago
Topics: cuda, huggingface-transformers, large-language-models, model-as-a-service, model-serving, pytorch, serverless-inference
Loading...