GitHub topics: lmdeploy
shell-nlp/gpt_server
gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR和TTS的开源框架。
Language: Python - Size: 4.28 MB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 193 - Forks: 16
Alannikos/FunGPT
In this fast-paced world, we all need a little something to spice up life. Whether you need a glass of sweet talk to lift your spirits or a dose of sharp retorts to let off steam, FunGPT has got you covered 🎉!
Language: Python - Size: 105 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 56 - Forks: 12
wtlow003/modal-llm-serving
Examples of serving LLM on Modal.
Language: Python - Size: 41 KB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0
csg2008/internlm2_lmdeploy_demo
书生浦语 LMDeploy 部署实验
Language: Python - Size: 2.93 KB - Last synced at: 3 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0
