GitHub topics: ai-observability
Arize-ai/phoenix
AI Observability & Evaluation
Language: Jupyter Notebook - Size: 338 MB - Last synced at: 38 minutes ago - Pushed at: about 2 hours ago - Stars: 6,057 - Forks: 467

openlit/openlit
Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.
Language: Python - Size: 45.2 MB - Last synced at: about 19 hours ago - Pushed at: about 19 hours ago - Stars: 1,659 - Forks: 164

truera/trulens
Evaluation and Tracking for LLM Experiments and AI Agents
Language: Python - Size: 344 MB - Last synced at: about 16 hours ago - Pushed at: about 16 hours ago - Stars: 2,586 - Forks: 217

lmnr-ai/lmnr
Laminar - open-source all-in-one platform for engineering AI products. Create data flywheel for your AI app. Traces, Evals, Datasets, Labels. YC S24.
Language: TypeScript - Size: 32.8 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 2,082 - Forks: 126

fiddler-labs/fiddler-examples
Language: Jupyter Notebook - Size: 289 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 13 - Forks: 2

radicalbit/radicalbit-ai-monitoring
A comprehensive solution for monitoring your AI models in production
Language: Python - Size: 37.1 MB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 82 - Forks: 11

Arize-ai/client_python
A python library to send data to Arize AI!
Language: Python - Size: 51.7 MB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 55 - Forks: 17

Dynatrace/obslab-llm-observability
Search for a holiday and get destination advice from an LLM. Observability by Dynatrace.
Language: HTML - Size: 8.13 MB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 8 - Forks: 141

fiddler-labs/fiddler-auditor
Fiddler Auditor is a tool to evaluate language models.
Language: Python - Size: 1.73 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 180 - Forks: 20

Pirat159/OpenAI-Sora-SV
OpenAI-Sora-SV is a versatile tool designed to enhance AI interactions through simplified voice commands. It streamlines user engagement by converting spoken language into actionable tasks, making technology more accessible for everyone.
Size: 7.81 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

alexis8112/OpenAI-Sora-SV
Size: 5.86 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

arthur-ai/arthur-sandbox 📦
Example projects for Arthur Model Monitoring Platform
Language: Jupyter Notebook - Size: 50.1 MB - Last synced at: 5 days ago - Pushed at: about 2 years ago - Stars: 4 - Forks: 3

openlit/.github
Size: 16.7 MB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 3 - Forks: 0

modelmetry/modelmetry-sdk-js
The Modelmetry JS/TS SDK allows developers to easily integrate Modelmetry’s advanced guardrails and monitoring capabilities into their LLM-powered applications.
Language: TypeScript - Size: 509 KB - Last synced at: 21 days ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

fiddler-labs/fiddler-report-generator
A report generator library for the ML models deployed on the Fiddler AI Observability platform
Language: Python - Size: 3.32 MB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 10 - Forks: 1

Shard-AI/Shard
Open Source Video Understanding API and Large Vision Model Observability Platform.
Language: Python - Size: 42 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

okahu/okahu-demo-openai
This repo hosts a chatbot that runs in Github Codespaces to demo Okahu AI Observability Cloud with OpenAI
Language: Python - Size: 1010 KB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 5 - Forks: 1

modelmetry/modelmetry-sdk-python
The Modelmetry Python SDK allows developers to easily integrate Modelmetry’s advanced guardrails and monitoring capabilities into their LLM-powered applications.
Language: Python - Size: 440 KB - Last synced at: 9 days ago - Pushed at: 7 months ago - Stars: 1 - Forks: 1

openlit/dokumetry-python 📦
Official Python Library to monitor your LLM Application with Doku
Language: Python - Size: 1.58 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

openlit/dokumetry-node 📦
Official NodeJS library for monitoring LLM Applications with Doku
Language: JavaScript - Size: 1.84 MB - Last synced at: 2 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 1

okahu/okahu-demo
This repo hosts a chatbot that runs in a docker container to demo Okahu AI Observability Cloud
Language: Python - Size: 666 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

Arize-ai/client_java
Java client to interact with Arize API
Language: Java - Size: 418 KB - Last synced at: 3 months ago - Pushed at: 9 months ago - Stars: 7 - Forks: 0
