Topic: "llm-observability"
langfuse/langfuse
🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
Language: TypeScript - Size: 19.9 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 10,594 - Forks: 959
comet-ml/opik
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
Language: Python - Size: 145 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 6,668 - Forks: 481
Helicone/helicone
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓
Language: TypeScript - Size: 409 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 3,640 - Forks: 364
Agenta-AI/agenta
The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.
Language: TypeScript - Size: 163 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 2,606 - Forks: 305
lmnr-ai/lmnr
Laminar - open-source all-in-one platform for engineering AI products. Crate data flywheel for you AI app. Traces, Evals, Datasets, Labels. YC S24.
Language: TypeScript - Size: 30.5 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 1,866 - Forks: 113
palico-ai/palico-ai
Build, Improve Performance, and Productionize your LLM Application with an Integrated Framework
Language: TypeScript - Size: 13.7 MB - Last synced at: 3 days ago - Pushed at: 5 months ago - Stars: 339 - Forks: 27
radicalbit/radicalbit-ai-monitoring
A comprehensive solution for monitoring your AI models in production
Language: Python - Size: 28.4 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 76 - Forks: 11
cyberark/agentwatch
A powerful AI observability framework that provides comprehensive insights into agent interactions across platforms, enabling developers to monitor, analyze, and optimize AI-driven applications with minimal integration effort.
Language: Python - Size: 4.82 MB - Last synced at: 12 days ago - Pushed at: 16 days ago - Stars: 57 - Forks: 2
teilomillet/hapax
The reliability layer between your code and LLM providers.
Language: Go - Size: 11 MB - Last synced at: 17 days ago - Pushed at: 4 months ago - Stars: 17 - Forks: 0
langfuse/langfuse-java
🪢 Auto-generated Java Client for Langfuse API
Language: Java - Size: 308 KB - Last synced at: 29 days ago - Pushed at: 29 days ago - Stars: 7 - Forks: 0
AndrMoura/streamlit-chatbot-analytics
Streamlit-based chatbot leveraging Ollama via LangChain and PostHog-LLM for advanced logging and monitoring
Language: Python - Size: 7.82 MB - Last synced at: 6 days ago - Pushed at: 12 months ago - Stars: 6 - Forks: 0
langfuse/oss-llmops-stack
Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-availability, while Langfuse focuses on detailed observability, prompt versioning, and performance evaluations.
Size: 316 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 5 - Forks: 0
modelmetry/modelmetry-sdk-js
The Modelmetry JS/TS SDK allows developers to easily integrate Modelmetry’s advanced guardrails and monitoring capabilities into their LLM-powered applications.
Language: TypeScript - Size: 509 KB - Last synced at: 24 days ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0
myscale/myscale_callback
MyScale Callback integrates with LangChain Callbacks, which seamlessly captures trace data from LangChain-based LLM applications and stores it in the MyScale database.
Language: Python - Size: 22.5 KB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 1 - Forks: 0
