GitHub / redhat-et / semantic_router
LLM Semantic Router: Intelligent Mixture-of-Models (MoM) System with Privacy Preservation and Prompt Guard. The semantic router intelligently directs OpenAI compliant API requests to the most suitable backend models based on semantic understanding of request content.
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/redhat-et%2Fsemantic_router
PURL: pkg:github/redhat-et/semantic_router
Stars: 19
Forks: 6
Open issues: 8
License: apache-2.0
Language: Python
Size: 3.23 MB
Dependencies parsed at: Pending
Created at: 4 months ago
Updated at: 14 days ago
Pushed at: 14 days ago
Last synced at: 13 days ago
Topics: bert-classification, bert-fine-tuning, envoy-proxy, golang, llm-inference, mixture-of-models, openai-api, pii-detection, prompt-guard, python, rust, semantic-router