ai-gateway | Topic | Ecosyste.ms: Repos

Topic: "ai-gateway"

Kong/kong

🦍 The Cloud-Native API Gateway and AI Gateway.

Language: Lua - Size: 90.6 MB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 40,597 - Forks: 4,904

BerriAI/litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

Language: Python - Size: 400 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 21,203 - Forks: 2,681

Portkey-AI/gateway

A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

Language: TypeScript - Size: 61.1 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 7,697 - Forks: 566

QuantumNous/new-api

AI模型接口管理与分发系统，支持将多种大模型转为统一格式调用，支持OpenAI、Claude等格式，可供个人或者企业内部管理与分发渠道使用，本项目基于One API二次开发。🍥 The next-generation LLM gateway and AI asset management system supports multiple languages.

Language: Go - Size: 4.8 MB - Last synced at: about 21 hours ago - Pushed at: 1 day ago - Stars: 6,969 - Forks: 1,364

alibaba/higress

🤖 AI Gateway | AI Native API Gateway

Language: Go - Size: 35.3 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 5,053 - Forks: 642

The AI-native proxy server for agents. Arch handles the pesky heavy lifting in building agentic apps - routing prompts to agents or specific tools, clarifying input, unifying access and observability to any LLM - so you can build smarter and ship faster.

Language: Rust - Size: 18.4 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 2,420 - Forks: 131

APIParkLab/APIPark

🦄云原生、超高性能 AI&API网关，LLM API 管理、分发系统、开放平台，支持所有AI API，不限于OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型，统一 API 请求和返回，API申请与审批，调用统计、负载均衡、多模型灾备。一键部署，开箱即用。Cloud native, ultra-high performance AI&API gateway, LLM API management, distribution system, open platform, supporting all AI APIs.

Language: TypeScript - Size: 59 MB - Last synced at: 7 days ago - Pushed at: 8 days ago - Stars: 1,063 - Forks: 152

stacklok/codegate

CodeGate: Security, Workspaces and Muxing for AI Applications, coding assistants, and agentic frameworks.

Language: Python - Size: 43.9 MB - Last synced at: 8 days ago - Pushed at: 9 days ago - Stars: 622 - Forks: 75

langdb/ai-gateway

Govern, Secure, and Optimize your AI Traffic. AI Gateway provides unified interface to all LLMs using OpenAI API format with a focus on performance and reliability. Built in Rust.

Language: Rust - Size: 71.8 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 561 - Forks: 16

Kenza-AI/sagify

LLMs and Machine Learning done easily

Language: Python - Size: 36.1 MB - Last synced at: 13 days ago - Pushed at: about 1 year ago - Stars: 439 - Forks: 69

envoyproxy/ai-gateway

Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI services.

Language: Go - Size: 3.77 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 222 - Forks: 44

Portkey-AI/portkey-python-sdk

Build reliable, secure, and production-ready AI apps easily.

Language: Python - Size: 7.35 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 71 - Forks: 18

Portkey-AI/portkey-node-sdk

Build reliable, secure, and production-ready AI apps easily.

Language: TypeScript - Size: 6.07 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 36 - Forks: 9

MagicAPI/ai-gateway

Built for demanding AI workflows, this gateway offers low-latency, provider-agnostic access, ensuring your AI applications run smoothly and quickly.

Language: Rust - Size: 129 KB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 34 - Forks: 7

adrianliechti/llama

Inference Hub for AI at Scale

Language: Go - Size: 1.61 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 33 - Forks: 5

NeuralTrust/TrustGate

A powerful, AI Gateway designed from scratch for AI

Language: Go - Size: 1.29 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 21 - Forks: 0

wx-yz/ai-gateway

Developer focused AI Gateway

Language: Ballerina - Size: 295 KB - Last synced at: 16 days ago - Pushed at: about 2 months ago - Stars: 11 - Forks: 2

cloud-apim/otoroshi-llm-extension

Set of Otoroshi plugins to interact with LLMs

Language: Scala - Size: 10.3 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 9 - Forks: 0

LianjiaTech/bella-openapi

Bella OpenAPI是一个提供了丰富的AI调用能力的API网关，可类比openrouter，与之不同的是除了提供聊天补全(chat-completion)能力外，还提供了文本向量化(text-embedding)、语音识别(ASR)、语音合成(TTS)、文生图、图生图等多种AI能力，同时集成了计费、限流和资源管理功能。且集成的所有能力都经过了大规模生产环境的验证。

Language: Java - Size: 2.52 MB - Last synced at: 1 day ago - Pushed at: 4 days ago - Stars: 8 - Forks: 2

langfuse/oss-llmops-stack

Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-availability, while Langfuse focuses on detailed observability, prompt versioning, and performance evaluations.

Size: 316 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 5 - Forks: 0