An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: llm-monitoring

WeitLion/brokle

📊 Observe and route LLM apps with Brokle, your open-source solution for production-grade AI observability and transparent infrastructure management.

Language: TypeScript - Size: 45.2 MB - Last synced at: about 9 hours ago - Pushed at: about 11 hours ago - Stars: 0 - Forks: 0

brokle-ai/brokle

AI Observability Platform – Advanced monitoring and analytics for LLM applications with intelligent gateway. 40+ AI-specific metrics, real-time insights, OpenAI-compatible.

Language: TypeScript - Size: 44.4 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 2 - Forks: 1

bluewave-labs/flagwise

Monitor, detect, and analyze security threats and Shadow AI in your LLM applications with comprehensive analytics and real-time alerting.

Language: JavaScript - Size: 368 KB - Last synced at: 7 days ago - Pushed at: 12 days ago - Stars: 29 - Forks: 3

Agenta-AI/agenta

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

Language: Python - Size: 180 MB - Last synced at: 16 days ago - Pushed at: 17 days ago - Stars: 3,110 - Forks: 363

BMolapisi/flagwise

FlagWise 🐙 detects Shadow AI and monitors LLM traffic in real time, exposing unauthorized or risky model use for security, compliance, and audit across enterprise systems.

Language: Python - Size: 332 KB - Last synced at: 25 days ago - Pushed at: 25 days ago - Stars: 0 - Forks: 0

kyopark2014/llm-monitoring

It shows how to monitoring LLM.

Language: TypeScript - Size: 66.5 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

pyladiesams/eval-llm-based-apps-jan2025

Create an evaluation framework for your LLM based app. Incorporate it into your test suite. Lay the monitoring foundation.

Language: Jupyter Notebook - Size: 11.6 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 7 - Forks: 5

aygp-dr/nexushive-agent-insights

Enterprise-grade observability for AI agents using OpenTelemetry

Language: Python - Size: 22.5 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0