Arize-ai/phoenix

AI Observability & Evaluation

Language: Jupyter Notebook - Size: 338 MB - Last synced at: about 14 hours ago - Pushed at: about 15 hours ago - Stars: 6,057 - Forks: 467

openlit/openlit

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

Language: Python - Size: 45.2 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 1,659 - Forks: 164

truera/trulens

Evaluation and Tracking for LLM Experiments and AI Agents

Language: Python - Size: 344 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 2,586 - Forks: 217

lmnr-ai/lmnr

Laminar - open-source all-in-one platform for engineering AI products. Create data flywheel for your AI app. Traces, Evals, Datasets, Labels. YC S24.

Language: TypeScript - Size: 32.8 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 2,082 - Forks: 126

fiddler-labs/fiddler-examples

Language: Jupyter Notebook - Size: 289 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 13 - Forks: 2

radicalbit/radicalbit-ai-monitoring

A comprehensive solution for monitoring your AI models in production

Language: Python - Size: 37.1 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 82 - Forks: 11

Arize-ai/client_python

A python library to send data to Arize AI!

Language: Python - Size: 51.7 MB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 55 - Forks: 17

Dynatrace/obslab-llm-observability

Search for a holiday and get destination advice from an LLM. Observability by Dynatrace.

Language: HTML - Size: 8.13 MB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 8 - Forks: 141

fiddler-labs/fiddler-auditor

Fiddler Auditor is a tool to evaluate language models.

Language: Python - Size: 1.73 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 180 - Forks: 20

Pirat159/OpenAI-Sora-SV

OpenAI-Sora-SV is a versatile tool designed to enhance AI interactions through simplified voice commands. It streamlines user engagement by converting spoken language into actionable tasks, making technology more accessible for everyone.

Size: 7.81 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

alexis8112/OpenAI-Sora-SV

Size: 5.86 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

arthur-ai/arthur-sandbox 📦

Example projects for Arthur Model Monitoring Platform

Language: Jupyter Notebook - Size: 50.1 MB - Last synced at: 6 days ago - Pushed at: about 2 years ago - Stars: 4 - Forks: 3

openlit/.github

Size: 16.7 MB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 3 - Forks: 0

modelmetry/modelmetry-sdk-js

The Modelmetry JS/TS SDK allows developers to easily integrate Modelmetry’s advanced guardrails and monitoring capabilities into their LLM-powered applications.

Language: TypeScript - Size: 509 KB - Last synced at: 21 days ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

fiddler-labs/fiddler-report-generator

A report generator library for the ML models deployed on the Fiddler AI Observability platform

Language: Python - Size: 3.32 MB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 10 - Forks: 1

Shard-AI/Shard

Open Source Video Understanding API and Large Vision Model Observability Platform.

Language: Python - Size: 42 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

okahu/okahu-demo-openai

This repo hosts a chatbot that runs in Github Codespaces to demo Okahu AI Observability Cloud with OpenAI

Language: Python - Size: 1010 KB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 5 - Forks: 1

modelmetry/modelmetry-sdk-python

The Modelmetry Python SDK allows developers to easily integrate Modelmetry’s advanced guardrails and monitoring capabilities into their LLM-powered applications.

Language: Python - Size: 440 KB - Last synced at: 9 days ago - Pushed at: 7 months ago - Stars: 1 - Forks: 1

openlit/dokumetry-python 📦

Official Python Library to monitor your LLM Application with Doku

Language: Python - Size: 1.58 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

openlit/dokumetry-node 📦

Official NodeJS library for monitoring LLM Applications with Doku

Language: JavaScript - Size: 1.84 MB - Last synced at: 2 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 1

okahu/okahu-demo

This repo hosts a chatbot that runs in a docker container to demo Okahu AI Observability Cloud

Language: Python - Size: 666 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

Arize-ai/client_java

Java client to interact with Arize API

Language: Java - Size: 418 KB - Last synced at: 3 months ago - Pushed at: 9 months ago - Stars: 7 - Forks: 0