GitHub topics: openai-compatible-api
aws-samples/easy-model-deployer
A user-friendly Command-line/SDK tool that makes it quickly and easier to deploy open-source LLMs on AWS
Language: Python - Size: 41.2 MB - Last synced at: about 22 hours ago - Pushed at: about 23 hours ago - Stars: 40 - Forks: 6
micz/ThunderAI
ThunderAI is a Thunderbird Addon that uses the capabilities of ChatGPT, Gemini or Ollama to enhance email management.
Language: JavaScript - Size: 2.21 MB - Last synced at: about 12 hours ago - Pushed at: about 13 hours ago - Stars: 122 - Forks: 21
ericc-ch/copilot-api
GitHub Copilot API wrapper to make it OpenAI compatible
Language: TypeScript - Size: 385 KB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 122 - Forks: 37
remsky/Kokoro-FastAPI
Dockerized FastAPI wrapper for Kokoro-82M text-to-speech model w/CPU ONNX and NVIDIA GPU PyTorch support, handling, and auto-stitching
Language: Python - Size: 59.3 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 2,550 - Forks: 356
gpustack/llama-box
LM inference server implementation based on *.cpp.
Language: C++ - Size: 1.97 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 182 - Forks: 16
cubist38/mlx-server-OAI-compat
A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friendly solution for running MLX-based vision and language models locally with an OpenAI-compatible interface.
Language: Python - Size: 20.2 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 29 - Forks: 7
killkxu/SoulEarth-Mustang-Core
Config files for my GitHub profile.
Language: Python - Size: 33.2 KB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 0 - Forks: 0
dogarrowtype/Spark-TTS-cli-api Fork of SparkAudio/Spark-TTS
Spark-TTS Text-to-Speech with an OpenAI-compatible API, supporting seamless, unlimited-length generations. Includes a CLI interface.
Language: Python - Size: 12.7 MB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 8 - Forks: 0
hcd233/Aris-AI-Model-Server
An OpenAI Compatible API which integrates LLM, Embedding and Reranker. 一个集成 LLM、Embedding 和 Reranker 的 OpenAI 兼容 API
Language: Python - Size: 1.05 MB - Last synced at: about 2 hours ago - Pushed at: 21 days ago - Stars: 14 - Forks: 1
gpustack/vox-box
A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
Language: Python - Size: 464 KB - Last synced at: 24 days ago - Pushed at: 24 days ago - Stars: 94 - Forks: 12
devidw/inferit
Visual inference exploration & experimentation playground
Language: Svelte - Size: 2.33 MB - Last synced at: 4 days ago - Pushed at: 5 months ago - Stars: 90 - Forks: 4
nakasyou/ai-to-openai-hono
An adapter to add OpenAI compatibility to your Hono app using the Vercel AI SDK
Language: TypeScript - Size: 0 Bytes - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0
pacphi/spring-ai-openrouter-example
Demonstrates that Spring AI can be configured to work with OpenRouter so that you can work with multiple LLMs through a single Open AI compatible interface. Potentially helpful when evaluating the performance and quality of model responses.
Language: Java - Size: 68.4 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0
marilena-baldi/jeeves
LLM based assistant running as a Telegram Bot.
Language: Python - Size: 14.6 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0
samestrin/llm-services-api
A FastAPI-powered REST API offering a comprehensive suite of natural language processing services using machine learning models with PyTorch and Transformers, packaged in a Docker container to run efficiently.
Language: Python - Size: 60.5 KB - Last synced at: about 1 month ago - Pushed at: 9 months ago - Stars: 2 - Forks: 1
ausboss/dbotjs
A Discordjs bot that uses OpenAI compatible endpoints for chatting.
Language: JavaScript - Size: 255 KB - Last synced at: 2 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 1
