neurdb/neurdb

AI-powered Autonomous Data System

Language: C - Size: 68.9 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 56 - Forks: 32

deepchecks/deepchecks

Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.

Language: Python - Size: 268 MB - Last synced at: 2 days ago - Pushed at: about 2 months ago - Stars: 3,773 - Forks: 267

grecosalvatore/drift-lens

Drift-Lens: an Unsupervised Drift Detection Framework for Deep Learning Classifiers on Unstructured Data

Language: Jupyter Notebook - Size: 17.4 MB - Last synced at: 2 days ago - Pushed at: 3 days ago - Stars: 9 - Forks: 1

evidentlyai/evidently

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

Language: Jupyter Notebook - Size: 277 MB - Last synced at: 4 days ago - Pushed at: 5 days ago - Stars: 6,050 - Forks: 666

NannyML/nannyml

nannyml: post-deployment data science in python

Language: Python - Size: 129 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 2,051 - Forks: 153

IFCA-Advanced-Computing/frouros

Frouros: an open-source Python library for drift detection in machine learning systems.

Language: Python - Size: 22.3 MB - Last synced at: 2 days ago - Pushed at: 3 months ago - Stars: 215 - Forks: 16

SeldonIO/alibi-detect

Algorithms for outlier, adversarial and drift detection

Language: Jupyter Notebook - Size: 35.3 MB - Last synced at: 8 days ago - Pushed at: about 1 month ago - Stars: 2,341 - Forks: 229

VectorInstitute/cyclops

A toolkit for evaluating and monitoring AI models in clinical settings

Language: Python - Size: 25.6 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 82 - Forks: 13

Renumics/awesome-open-data-centric-ai

Curated list of open source tooling for data-centric AI on unstructured data.

Size: 572 KB - Last synced at: 8 days ago - Pushed at: over 1 year ago - Stars: 716 - Forks: 35

awesome-mlops/awesome-ml-monitoring

A curated list of awesome open source tools and commercial products for monitoring data quality, monitoring model performance, and profiling data 🚀

Size: 4.88 KB - Last synced at: 12 days ago - Pushed at: 12 months ago - Stars: 75 - Forks: 7

MAIF/eurybia

⚓ Eurybia monitors model drift over time and securizes model deployment with data validation

Language: Jupyter Notebook - Size: 32.9 MB - Last synced at: 13 days ago - Pushed at: 6 months ago - Stars: 207 - Forks: 25

VishalKumar-S/Sales_Conversion_Optimization_MLOps_Project

Sales Conversion Optimization MLOps: Boost revenue with AI-powered insights. Features H2O AutoML, ZenML pipelines, Neptune.ai tracking, data validation, drift analysis, CI/CD, Streamlit app, Docker, and GitHub Actions. Includes e-mail alerts, Discord/Slack integration, and SHAP interpretability. Streamline ML workflow and enhance sales performance.

Language: HTML - Size: 13.5 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 17 - Forks: 3

JBris/nannyml-test

Testing out NannyML

Language: Jupyter Notebook - Size: 23.2 MB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

roboflow/roboflow-collect

Passively collect images for computer vision datasets on the edge.

Language: Python - Size: 601 KB - Last synced at: 5 days ago - Pushed at: over 1 year ago - Stars: 31 - Forks: 1

radicalbit/radicalbit-ai-monitoring

A comprehensive solution for monitoring your AI models in production

Language: Python - Size: 28.4 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 76 - Forks: 11

mitre/menelaus

Online and batch-based concept and data drift detection algorithms to monitor and maintain ML performance.

Language: Python - Size: 60.2 MB - Last synced at: 3 days ago - Pushed at: over 1 year ago - Stars: 67 - Forks: 7

ilias-ant/adversarial-validation

A tiny framework to perform adversarial validation of your training and test data.

Language: Python - Size: 641 KB - Last synced at: 2 days ago - Pushed at: 3 months ago - Stars: 20 - Forks: 0

jaygwelsh/PhiMonitor-ML-Drift-Overfitting-Detector

A Python library for monitoring machine learning models, detecting data drift and overfitting to ensure robust and reliable performance.

Language: Python - Size: 17.6 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

pyladiesams/model-drift-beginner-dec2022

Learn how to handle model drift and perform test-based model monitoring

Language: Jupyter Notebook - Size: 1.59 MB - Last synced at: about 2 months ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

vathymut/dsos Fork of rbc-research/dsos

Dataset shift with outlier scores

Language: R - Size: 1.45 MB - Last synced at: 16 days ago - Pushed at: about 2 years ago - Stars: 2 - Forks: 1

evidentlyai/ml_observability_course

Free Open-source ML observability course for data scientists and ML engineers. Learn how to monitor and debug your ML models in production.

Language: Jupyter Notebook - Size: 25.2 MB - Last synced at: 12 months ago - Pushed at: over 1 year ago - Stars: 56 - Forks: 18

grecosalvatore/DriftLensDemo

Drift Lens Demo

Language: Python - Size: 13.6 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 0

labrijisaad/AXA-Direct-ML-Apprenticeship

Repository showcasing my Machine Learning Engineering Apprenticeship at AXA-Direct Assurance, contributing to the development and implementation of Machine Learning solutions.

Size: 6.84 KB - Last synced at: 2 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

karayanni/Edge_ML_KS-Test

A system for monitoring data distribution shifts in distributed settings

Language: Jupyter Notebook - Size: 1.67 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

Gianatmaja/WhizML

A reusable codebase for fast data science and machine learning experimentation, integrating various open-source tools to support automatic EDA, ML models experimentation and tracking, model inference, model explainability, bias, and data drift analysis.

Language: Python - Size: 59.6 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

uncleDecart/data_drift

Data Drift detection using auto encoders

Language: Jupyter Notebook - Size: 8.88 MB - Last synced at: 2 months ago - Pushed at: almost 3 years ago - Stars: 2 - Forks: 2

joycekuohmoukouri/creditworthiness-scoring

Language: CSS - Size: 67.7 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

harcel/unstable_populations

The Unstable Population Indicator

Language: Jupyter Notebook - Size: 64.5 KB - Last synced at: 12 days ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

waterdipai/waterdip

Open-source ML Observability Platform

Language: Python - Size: 3.75 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 40 - Forks: 7

Gianatmaja/ML-Monitoring-for-Attrition-Risk-Assessment-System

An ML monitoring framework, applied to an attrition risk assessment system

Language: Python - Size: 60.5 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

YenLinWu/Model_Drift

"Past performance of machine learning model is no guarantee of future results." We call it "model drift" or "model decay". This repository will introduce various methods for detecting model drift.

Language: Jupyter Notebook - Size: 20.1 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

aws-samples/sagemaker-model-monitor-bring-your-own-container

In this repository, we will present techniques to detect covariate drift, and demonstrate how to incorporate your own custom drift detection algorithms and visualizations with SageMaker model monitor.

Language: Jupyter Notebook - Size: 960 KB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 12 - Forks: 3

robinsonkwame/adversarial_labeller

Adversarial labeller is a sklearn compatible instance labelling tool for model selection under data drift.

Language: Python - Size: 175 KB - Last synced at: 18 days ago - Pushed at: about 2 years ago - Stars: 3 - Forks: 1

gokul-pv/ModelAndDataDrift

A repo to detect drift in data using Alibi Detect

Language: Jupyter Notebook - Size: 2.48 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

Nachimak28/evidently-data-analysis

A ⚡️ Lightning.ai ⚡️ component for train and test data drift detection

Language: Python - Size: 2.16 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 6 - Forks: 2

ddrous/morebikes

Predicting the number of bicycles at rental stations.

Language: Jupyter Notebook - Size: 1.8 MB - Last synced at: almost 2 years ago - Pushed at: about 3 years ago - Stars: 2 - Forks: 0