lmnr-ai/lmnr

Laminar - open-source all-in-one platform for engineering AI products. Crate data flywheel for you AI app. Traces, Evals, Datasets, Labels. YC S24.

Language: TypeScript - Size: 30.5 MB - Last synced at: about 21 hours ago - Pushed at: about 22 hours ago - Stars: 1,866 - Forks: 113

Arize-ai/phoenix

AI Observability & Evaluation

Language: Jupyter Notebook - Size: 299 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 5,407 - Forks: 396

openlit/openlit

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

Language: Python - Size: 45 MB - Last synced at: 11 days ago - Pushed at: 14 days ago - Stars: 1,400 - Forks: 137

Arize-ai/client_python

A python library to send data to Arize AI!

Language: Python - Size: 51.5 MB - Last synced at: 9 days ago - Pushed at: 13 days ago - Stars: 50 - Forks: 15

fiddler-labs/fiddler-auditor

Fiddler Auditor is a tool to evaluate language models.

Language: Python - Size: 1.73 MB - Last synced at: 16 days ago - Pushed at: about 1 year ago - Stars: 178 - Forks: 20

arthur-ai/arthur-sandbox 📦

Example projects for Arthur Model Monitoring Platform

Language: Jupyter Notebook - Size: 50.1 MB - Last synced at: 3 days ago - Pushed at: about 2 years ago - Stars: 4 - Forks: 3

fiddler-labs/fiddler-examples

Language: Jupyter Notebook - Size: 289 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 13 - Forks: 2

Dynatrace/obslab-llm-observability

Search for a holiday and get destination advice from an LLM. Observability by Dynatrace.

Language: HTML - Size: 8.12 MB - Last synced at: 16 days ago - Pushed at: 2 months ago - Stars: 6 - Forks: 140

openlit/.github

Size: 16.7 MB - Last synced at: 14 days ago - Pushed at: 5 months ago - Stars: 3 - Forks: 0

radicalbit/radicalbit-ai-monitoring

A comprehensive solution for monitoring your AI models in production

Language: Python - Size: 28.4 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 76 - Forks: 11

modelmetry/modelmetry-sdk-js

The Modelmetry JS/TS SDK allows developers to easily integrate Modelmetry’s advanced guardrails and monitoring capabilities into their LLM-powered applications.

Language: TypeScript - Size: 509 KB - Last synced at: 20 days ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

fiddler-labs/fiddler-report-generator

A report generator library for the ML models deployed on the Fiddler AI Observability platform

Language: Python - Size: 3.32 MB - Last synced at: 19 days ago - Pushed at: over 1 year ago - Stars: 10 - Forks: 1

Shard-AI/Shard

Open Source Video Understanding API and Large Vision Model Observability Platform.

Language: Python - Size: 42 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

okahu/okahu-demo-openai

This repo hosts a chatbot that runs in Github Codespaces to demo Okahu AI Observability Cloud with OpenAI

Language: Python - Size: 1010 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 5 - Forks: 1

modelmetry/modelmetry-sdk-python

The Modelmetry Python SDK allows developers to easily integrate Modelmetry’s advanced guardrails and monitoring capabilities into their LLM-powered applications.

Language: Python - Size: 440 KB - Last synced at: 8 days ago - Pushed at: 4 months ago - Stars: 1 - Forks: 1

openlit/dokumetry-python 📦

Official Python Library to monitor your LLM Application with Doku

Language: Python - Size: 1.58 MB - Last synced at: 11 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

openlit/dokumetry-node 📦

Official NodeJS library for monitoring LLM Applications with Doku

Language: JavaScript - Size: 1.84 MB - Last synced at: about 19 hours ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 1

okahu/okahu-demo

This repo hosts a chatbot that runs in a docker container to demo Okahu AI Observability Cloud

Language: Python - Size: 666 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

Arize-ai/client_java

Java client to interact with Arize API

Language: Java - Size: 418 KB - Last synced at: 15 days ago - Pushed at: 7 months ago - Stars: 7 - Forks: 0