Data

Tools

Indexes

Applications

Experiments

Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: llm-monitoring

Agenta-AI/agenta

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

Language: Python - Size: 171 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 2,795 - Forks: 330

pyladiesams/eval-llm-based-apps-jan2025

Create an evaluation framework for your LLM based app. Incorporate it into your test suite. Lay the monitoring foundation.

Language: Jupyter Notebook - Size: 11.6 MB - Last synced at: 28 days ago - Pushed at: about 1 month ago - Stars: 7 - Forks: 5

aygp-dr/nexushive-agent-insights

Enterprise-grade observability for AI agents using OpenTelemetry

Language: Python - Size: 22.5 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

kyopark2014/llm-monitoring

It shows how to monitoring LLM.

Language: TypeScript - Size: 66.4 MB - Last synced at: 2 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

Related Keywords
llm-monitoring 4 token-logger 1 dashboard 1 amazon-bedrock 1 telemetry 1 smolagents 1 opentelemetry 1 ai-agents 1 agent-observability 1 workshop 1 llms 1 llmops 1 llm-testing 1 llm-test 1 llm-evaluation-metrics 1 llm-evaluation-framework 1 llm-evals 1 llm-eval 1 llm 1 rag-evaluation 1 prompt-management 1 prompt-engineering 1 llmops-platform 1 llm-tools 1 llm-playground 1 llm-platform 1 llm-observability 1 llm-framework 1 llm-evaluation 1 llm-as-a-judge 1