GitHub / wtlow003 / modal-llm-serving

Examples of serving LLM on Modal.

JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wtlow003%2Fmodal-llm-serving
PURL: pkg:github/wtlow003/modal-llm-serving

Stars: 1
Forks: 0
Open issues: 0

License: mit
Language: Python
Size: 41 KB
Dependencies parsed at: Pending

Created at: over 1 year ago
Updated at: about 1 year ago
Pushed at: about 1 year ago
Last synced at: 3 months ago

Topics: llm, lmdeploy, modal, model-serving, openai, openai-api, sglang, vllm

Loading...