GitHub / shell-nlp / gpt_server
gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR和TTS的开源框架。
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shell-nlp%2Fgpt_server
Stars: 173
Forks: 16
Open issues: 5
License: apache-2.0
Language: Python
Size: 4.67 MB
Dependencies parsed at: Pending
Created at: over 1 year ago
Updated at: 9 days ago
Pushed at: 9 days ago
Last synced at: 9 days ago
Topics: asr, embedding, fastchat, function-calling, gpt, infinity, llama, llm, lmdeploy, openai, prompt-injection, rerank, sglang, text-moderation, tts, vllm
Loading...