GitHub topics: model-monitoring

Repositories

evidentlyai/evidently

Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

Language: Jupyter Notebook - Size: 320 MB - Last synced at: about 17 hours ago - Pushed at: about 18 hours ago - Stars: 6,578 - Forks: 722

demml/scouter

Monitoring for AI Applications

Language: Rust - Size: 6.08 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 6 - Forks: 0

traceloop/openllmetry

Open-source observability for your LLM application, based on OpenTelemetry

Language: Python - Size: 39.4 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 6,256 - Forks: 789

irfanerencomert/mlops-pipeline

Scalable and production-ready MLOps pipeline using MLflow, Docker, Prometheus & GitHub Actions — featuring automated retraining and model monitoring.

Language: Python - Size: 344 KB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 0 - Forks: 0

Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.

Language: Python - Size: 268 MB - Last synced at: 5 days ago - Pushed at: 10 days ago - Stars: 3,889 - Forks: 277

DataTalksClub/mlops-zoomcamp

Free MLOps course from DataTalks.Club

Language: Jupyter Notebook - Size: 11.2 MB - Last synced at: 6 days ago - Pushed at: 27 days ago - Stars: 13,260 - Forks: 2,628

traceloop/hub

High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included

Language: Rust - Size: 603 KB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 128 - Forks: 22

Arize-ai/client_python

A python library to send data to Arize AI!

Language: Python - Size: 51.6 MB - Last synced at: 10 days ago - Pushed at: 11 days ago - Stars: 56 - Forks: 18

fiddler-labs/fiddler-examples

Language: Jupyter Notebook - Size: 290 MB - Last synced at: 10 days ago - Pushed at: 11 days ago - Stars: 15 - Forks: 3

traceloop/openllmetry-js

Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry

Language: TypeScript - Size: 14.3 MB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 347 - Forks: 42

awesome-mlops/awesome-ml-monitoring

A curated list of awesome open source tools and commercial products for monitoring data quality, monitoring model performance, and profiling data 🚀

Size: 4.88 KB - Last synced at: 3 days ago - Pushed at: over 1 year ago - Stars: 84 - Forks: 8

VectorInstitute/cyclops

A toolkit for evaluating and monitoring AI models in clinical settings

Language: Python - Size: 27.4 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 86 - Forks: 13

evidentlyai/tracely

LLM application tracing based on OpenTelemetry

Language: Python - Size: 166 KB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 13 - Forks: 3

prabhuomkar/bitbeast

Experiments with Model Training, Deployment & Monitoring

Language: Python - Size: 896 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 39 - Forks: 4

arthur-ai/arthur-sandbox 📦

Example projects for Arthur Model Monitoring Platform

Language: Jupyter Notebook - Size: 50.1 MB - Last synced at: 6 days ago - Pushed at: over 2 years ago - Stars: 5 - Forks: 3

lpalbou/ForgeLLM

A comprehensive toolkit for end-to-end continued pre-training, fine-tuning, monitoring, testing and publishing of language models with MLX-LM

Language: Python - Size: 7.86 MB - Last synced at: 16 days ago - Pushed at: about 2 months ago - Stars: 3 - Forks: 0

MAIF/eurybia

⚓ Eurybia monitors model drift over time and securizes model deployment with data validation

Language: Jupyter Notebook - Size: 32.9 MB - Last synced at: about 1 month ago - Pushed at: 11 months ago - Stars: 212 - Forks: 25

NannyML/nannyml

nannyml: post-deployment data science in python

Language: Python - Size: 129 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 2,082 - Forks: 162

evidentlyai/ml_observability_course

Free Open-source ML observability course for data scientists and ML engineers. Learn how to monitor and debug your ML models in production.

Language: Jupyter Notebook - Size: 25.2 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 92 - Forks: 32

awesome-mlops/awesome-mlops-kubernetes

A curated list of awesome open source tools and commercial products that will help you train, deploy, monitor, version, scale, and secure your production machine learning on kubernetes 🚀

Size: 3.91 KB - Last synced at: about 1 month ago - Pushed at: over 3 years ago - Stars: 17 - Forks: 2

rstudio/vetiver-python

Version, share, deploy, and monitor models.

Language: Python - Size: 6.9 MB - Last synced at: 11 days ago - Pushed at: 6 months ago - Stars: 68 - Forks: 18

slv-ai/MLOps-zoomcamp

MLOps course from DataTalks.club

Language: Jupyter Notebook - Size: 175 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

happyvibess/mlflow-assist

Language: Python - Size: 75.2 KB - Last synced at: 2 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

Edmon02/edge-mlops-monitor

A lightweight, resource-efficient MLOps monitoring solution for machine learning models deployed on edge devices. Features system health tracking, model I/O logging, drift detection, and cloud telemetry.

Language: Python - Size: 105 KB - Last synced at: 2 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

TaimoorKhan10/MLOps-Forge

A complete production-ready MLOps framework with built-in distributed training, monitoring, and CI/CD. Deploy ML models to production with confidence using our battle-tested infrastructure.

Language: Python - Size: 221 KB - Last synced at: 21 days ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

aws-samples/amazon-sagemaker-mlops-workshop

MLOps workshop with Amazon SageMaker

Language: Jupyter Notebook - Size: 5.16 MB - Last synced at: 3 months ago - Pushed at: 5 months ago - Stars: 100 - Forks: 30

jxareas/mlops-zoomcamp-2025

MLOps Zoomcamp 2025.

Language: Jupyter Notebook - Size: 98 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

NimbleBoxAI/nbox

The official python package for NimbleBox. Exposes all APIs as CLIs and contains modules to make ML 🌸

Language: Python - Size: 63.7 MB - Last synced at: 6 days ago - Pushed at: almost 2 years ago - Stars: 87 - Forks: 13

newking9088/case_study_ml_predictive_modeling

A comprehensive case study on implementing predictive modeling in insurance

Size: 885 KB - Last synced at: 17 days ago - Pushed at: 4 months ago - Stars: 0 - Forks: 1

pyladiesams/model-drift-beginner-dec2022

Learn how to handle model drift and perform test-based model monitoring

Language: Jupyter Notebook - Size: 1.59 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 2 - Forks: 0

dataninsight/mlops-zoomcamp

This is the repository for my MLOPS bootcamp with DataTalkClubs https://github.com/DataTalksClub/mlops-zoomcamp

Language: Jupyter Notebook - Size: 1.95 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

realjules/monitor.ai

monitor.ai: Non-intrusive monitoring for FDA-approved medical AI, helping healthcare organizations ensure safety and compliance without modifying validated models.

Language: Jupyter Notebook - Size: 163 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

aporia-ai/inferencedb

🚀 Stream inferences of real-time ML models in production to any data lake (Experimental)

Language: Python - Size: 251 KB - Last synced at: 4 months ago - Pushed at: about 3 years ago - Stars: 80 - Forks: 3

jodhie/building_insurance_predictive_modeling

A comprehensive case study on implementing predictive modeling in insurance

Size: 173 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

MI2DataLab/RAMAI

This repository consists of collected data and code used to conduct studies described in the "Resistance Against Manipulative AI: Key Factors and Possible Actions" article, which was presented at 27th European Conference on Artificial Intelligence (2024).

Language: Python - Size: 20.4 MB - Last synced at: about 15 hours ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

JBris/nannyml-test

Testing out NannyML

Language: Jupyter Notebook - Size: 23.2 MB - Last synced at: 1 day ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

katonic-dev/explainit

A modern, enterprise-ready business intelligence web application

Language: Python - Size: 7.31 MB - Last synced at: 16 days ago - Pushed at: over 2 years ago - Stars: 33 - Forks: 5

TouradBaba/model_engineering

This repository hosts a machine learning tool for breast cancer classification, emphasizing model interpretability. It is deployed on Streamlit Cloud, with a PostgreSQL database for tracking results and data drift, and includes an automated retraining workflow.

Language: Jupyter Notebook - Size: 12.7 MB - Last synced at: 4 months ago - Pushed at: 8 months ago - Stars: 0 - Forks: 1

jaygwelsh/PhiMonitor-ML-Drift-Overfitting-Detector

A Python library for monitoring machine learning models, detecting data drift and overfitting to ensure robust and reliable performance.

Language: Python - Size: 17.6 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

squaredev-io/whitebox

[Not Actively Maintained] Whitebox is an open source E2E ML monitoring platform with edge capabilities that plays nicely with kubernetes

Language: Python - Size: 21.2 MB - Last synced at: 4 months ago - Pushed at: about 2 years ago - Stars: 183 - Forks: 5

OLAMIDE100/Capstone-Project-Mlops-ZoomCamp

This is a capstone project associated with MLOps Zoomcamp. The end goal of the project is to build an end-to-end machine learning project containing feature engineering, training, validation, tracking, modeel deployment, hosting, and general engineering best practices aimed at making house price predictions.

Language: Python - Size: 1.08 MB - Last synced at: 5 months ago - Pushed at: almost 3 years ago - Stars: 13 - Forks: 2

Md-Emon-Hasan/Evidently-AI

Evidently AI in tracking, analyzing, and visualizing machine learning model performance and data drift ensure their reliability over time.

Language: Jupyter Notebook - Size: 8.08 MB - Last synced at: 20 days ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

paschalugwu/Developing-ML-Workflows-On-AWS

Developed an image classification model for Scones Unlimited to identify delivery vehicles (bicycles vs. motorcycles) to enhance routing and loading bay assignments, thereby optimizing operational efficiency.

Language: Jupyter Notebook - Size: 784 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

vathymut/dsos Fork of rbc-research/dsos

Dataset shift with outlier scores

Language: R - Size: 1.45 MB - Last synced at: 21 days ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 1

spzj/mlops-zoomcamp

Solutions to the MLOps Zoomcamp course

Language: HTML - Size: 19.3 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

codex-0915/mlops-zoomcamp

This repository contains the notes, practice and sample outputs, homeworks, etc, from DataTalks.Club's MLOps Zoomcamp 2024 Cohort

Language: Jupyter Notebook - Size: 154 MB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

aditikhare007/Building-Production-Grade-LLMs

Aditi @ Building Production Grade LLMs - * Thank you AI community for visiting my repository - Stay tuned for awesome Dev-ops AI Learning Resources ** ** If you find the repository useful please give it a star - Thank you for visiting my repository - Happy Learning **

Size: 8.79 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 0