tim-learn/awesome-test-time-adaptation

Collection of awesome test-time (domain/batch/instance) adaptation methods

Size: 2.16 MB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 961 - Forks: 68

aangelopoulos/conformal-prediction

Lightweight, useful implementation of conformal prediction on real data.

Language: Jupyter Notebook - Size: 38.8 MB - Last synced at: 4 days ago - Pushed at: about 1 year ago - Stars: 886 - Forks: 103

mariodoebler/test-time-adaptation

A repository and benchmark for online test-time adaptation.

Language: Python - Size: 6.15 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 231 - Forks: 27

IFCA-Advanced-Computing/frouros

Frouros: an open-source Python library for drift detection in machine learning systems.

Language: Python - Size: 22.3 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 220 - Forks: 16

divelab/GOOD

GOOD: A Graph Out-of-Distribution Benchmark [NeurIPS 2022 Datasets and Benchmarks]

Language: Python - Size: 16.9 MB - Last synced at: 9 days ago - Pushed at: 3 months ago - Stars: 196 - Forks: 19

weitianxin/awesome-distribution-shift

A curated list of papers and resources about the distribution shift in machine learning.

Size: 593 KB - Last synced at: 27 days ago - Pushed at: almost 2 years ago - Stars: 117 - Forks: 9

LFhase/CIGA

[NeurIPS 2022] Learning Causally Invariant Representations for Out-of-Distribution Generalization on Graphs

Language: Python - Size: 618 KB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 94 - Forks: 9

SJTU-DMTai/DoubleAdapt

The official API of DoubleAdapt (KDD'23), an incremental learning framework for online stock trend forecasting, WITHOUT dependencies on the qlib package.

Language: Python - Size: 6.67 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 87 - Forks: 13

mims-harvard/Raincoat

Domain Adaptation for Time Series Under Feature and Label Shifts

Language: Jupyter Notebook - Size: 2.31 MB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 87 - Forks: 10

EdisonLeeeee/GreatX

A graph reliability toolbox based on PyTorch and PyTorch Geometric (PyG).

Language: Python - Size: 8.14 MB - Last synced at: 6 days ago - Pushed at: 8 months ago - Stars: 85 - Forks: 13

NJUyued/PRG4SSL-MNAR

"Towards Semi-supervised Learning with Non-random Missing Labels" by Yue Duan (ICCV 2023)

Language: Python - Size: 6.92 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 78 - Forks: 1

google-deepmind/distribution_shift_framework

This repository contains the code of the distribution shift framework presented in A Fine-Grained Analysis on Distribution Shift (Wiles et al., 2022).

Language: Python - Size: 66.4 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 77 - Forks: 7

qitianwu/GraphOOD-GNNSafe

The official implementation for ICLR23 paper "GNNSafe: Energy-based Out-of-Distribution Detection for Graph Neural Networks"

Language: Python - Size: 2.37 MB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 64 - Forks: 4

addtt/object-centric-library

Library for the training and evaluation of object-centric models (ICML 2022)

Language: Python - Size: 11.2 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 60 - Forks: 2

namkoong-lab/whyshift

A python package providing a benchmark with various specified distribution shift patterns.

Language: Jupyter Notebook - Size: 2.65 MB - Last synced at: 30 days ago - Pushed at: over 1 year ago - Stars: 57 - Forks: 4

ChandlerBang/GTrans

[ICLR'23] Implementation of "Empowering Graph Representation Learning with Test-Time Graph Transformation"

Language: Python - Size: 230 KB - Last synced at: about 2 months ago - Pushed at: almost 2 years ago - Stars: 56 - Forks: 6

chrisyeh96/sustaingym

Reinforcement Learning Environments for Sustainable Energy Systems

Language: HTML - Size: 132 MB - Last synced at: about 21 hours ago - Pushed at: about 1 year ago - Stars: 51 - Forks: 12

GentleZhu/Shift-Robust-GNNs

"Shift-Robust GNNs: Overcoming the Limitations of Localized Graph Training Data" (NeurIPS 21')

Language: Python - Size: 9.99 MB - Last synced at: about 2 months ago - Pushed at: almost 3 years ago - Stars: 47 - Forks: 7

bit-ml/AnoShift

Language: Python - Size: 13.7 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 44 - Forks: 4

vita-epfl/ttt-plus-plus

[NeurIPS21] TTT++: When Does Self-supervised Test-time Training Fail or Thrive?

Language: Python - Size: 800 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 44 - Forks: 3

acmi-lab/RLSbench

Code and results accompanying our paper titled RLSbench: Domain Adaptation under Relaxed Label Shift

Language: Python - Size: 42.9 MB - Last synced at: over 1 year ago - Pushed at: almost 2 years ago - Stars: 32 - Forks: 5

weijiaheng/Drops

[ICLR 2023] Official Tensorflow implementation of "Distributionally Robust Post-hoc Classifiers under Prior Shifts"

Language: Python - Size: 924 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 29 - Forks: 0

monk1337/Awesome-Robust-Machine-Learning

A curated list of Robust Machine Learning papers/articles and recent advancements.

Size: 456 KB - Last synced at: 26 days ago - Pushed at: over 2 years ago - Stars: 29 - Forks: 0

jameszhou-gl/gpt-4v-distribution-shift

Code for "How Well Does GPT-4V(ision) Adapt to Distribution Shifts? A Preliminary Investigation"

Language: Jupyter Notebook - Size: 3.9 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 28 - Forks: 2

mfederici/dsit

Implementation of the models and datasets used in "An Information-theoretic Approach to Distribution Shifts"

Language: Jupyter Notebook - Size: 1.29 MB - Last synced at: 24 days ago - Pushed at: over 3 years ago - Stars: 25 - Forks: 1

ryoungj/optdom

[ICLR'22] Self-supervised learning optimally robust representations for domain shift.

Language: Python - Size: 15 MB - Last synced at: about 1 year ago - Pushed at: over 3 years ago - Stars: 22 - Forks: 3

mala-lab/ADShift

Official PyTorch implementation of the ICCV'23 paper “Anomaly Detection under Distribution Shift”

Language: Python - Size: 59.6 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 21 - Forks: 3

KingJamesSong/RankFeat

NeurIPS22 "RankFeat: Rank-1 Feature Removal for Out-of-distribution Detection" and T-PAMI Extension

Language: Python - Size: 2.48 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 19 - Forks: 1

monk1337/Awesome-Distribution-Shift

A curated list of Distribution Shift papers/articles and recent advancements.

Size: 547 KB - Last synced at: 3 days ago - Pushed at: over 2 years ago - Stars: 18 - Forks: 1

yaodongyu/ProjNorm

Predicting Out-of-Distribution Error with the Projection Norm

Language: Python - Size: 20.5 KB - Last synced at: over 1 year ago - Pushed at: almost 3 years ago - Stars: 15 - Forks: 1

biquality-learn/biquality-learn

A Python Library for Biquality Learning

Language: Python - Size: 132 KB - Last synced at: 15 days ago - Pushed at: about 2 months ago - Stars: 14 - Forks: 1

CGCL-codes/TransferAttackSurrogates

The official code of IEEE S&P 2024 paper "Why Does Little Robustness Help? A Further Step Towards Understanding Adversarial Transferability". We study how to train surrogates model for boosting transfer attack.

Language: Python - Size: 147 KB - Last synced at: 7 months ago - Pushed at: 9 months ago - Stars: 14 - Forks: 3

neerajwagh/evaluating-eeg-representations

Resources for the paper titled "Evaluating Latent Space Robustness and Uncertainty of EEG-ML Models under Realistic Distribution Shifts". Accepted at NeurIPS 2022.

Size: 5.86 KB - Last synced at: over 1 year ago - Pushed at: almost 2 years ago - Stars: 14 - Forks: 0

rgklab/detectron

Official repository for the ICLR 2023 paper "A Learning Based Hypothesis Test for Harmful Covariate Shift"

Language: Python - Size: 17.7 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 10 - Forks: 2

Katalip/ca-stinv-cnn

Code for "Improving Stain Invariance of CNNs for Segmentation by Fusing Channel Attention and Domain-Adversarial Training"

Language: Python - Size: 16.8 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 10 - Forks: 0

NJUyued/RDA4RobustSSL

"RDA: Reciprocal Distribution Alignment for Robust Semi-supervised Learning" by Yue Duan (ECCV 2022)

Language: Python - Size: 10 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 9 - Forks: 0

martinwimpff/eeg-otta

Language: Python - Size: 1.59 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 7 - Forks: 0

pritamqu/OOD-VSSL

[NeurIPS 2023 (Spotlight)] Uncovering the Hidden Dynamics of Video Self-supervised Learning under Distribution Shifts

Language: Python - Size: 10.1 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 7 - Forks: 0

StanfordASL/data-lifecycle-management

Code accompanying the AI4Space 2022 paper "Data Lifecycle Management in Evolving Input Distributions for Learning-based Aerospace Applications" by Somrita Banerjee, Apoorva Sharma, Edward Schmerling, Max Spolaor, Michael Nemerouf, and Marco Pavone.

Language: Jupyter Notebook - Size: 403 MB - Last synced at: 20 days ago - Pushed at: 6 months ago - Stars: 5 - Forks: 1

VietHoang1512/GLOT

Global-Local Regularization Via Distributional Robustness (AISTATS 2023)

Language: Python - Size: 3.77 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 5 - Forks: 1

luisoala/non-iid-ssdl

A systematic approach to class distribution mismatch in semi-supervised learning using deep dataset dissimilarity measures

Language: Python - Size: 1.04 MB - Last synced at: 4 days ago - Pushed at: about 3 years ago - Stars: 5 - Forks: 1

deepmancer/rss-training-iclr2024

This is the official repository for the ICLR 2024 paper Out-Of-Domain Unlabeled Data Improves Generalization.

Language: TeX - Size: 31 MB - Last synced at: 8 months ago - Pushed at: 9 months ago - Stars: 4 - Forks: 0

kevinsbello/iscan

A Python 3 package for identifying distribution shifts (a.k.a feature-shifts) between datasets. Official implementation of the paper: "iSCAN: Identifying Causal Mechanism Shifts among Nonlinear Additive Noise Models".

Language: Python - Size: 271 KB - Last synced at: 20 days ago - Pushed at: 11 months ago - Stars: 4 - Forks: 2

im-ethz/pub-gdu4dg

Gated Domain Units (GDU) aim to make your deep learning models robust against distribution shifts when applied in the real-world.

Language: Jupyter Notebook - Size: 46.2 MB - Last synced at: over 1 year ago - Pushed at: almost 2 years ago - Stars: 4 - Forks: 0

acmi-lab/OnlineLabelShift

Code accompanying our paper titled Online Label Shift: Optimal Dynamic Regret meets Practical Algorithms

Language: Python - Size: 91.8 KB - Last synced at: about 2 months ago - Pushed at: about 2 years ago - Stars: 4 - Forks: 0

RichardObi/frd-score

Official implementation of the Fréchet Radiomics Distance | pip install frd-score

Language: Python - Size: 195 KB - Last synced at: 12 days ago - Pushed at: 12 months ago - Stars: 3 - Forks: 1

Linxyhaha/TDRO

Temporally and Distributionally Robust Optimization for Cold-start Recommendation (AAAI'24)

Language: Python - Size: 332 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 3 - Forks: 0

Weixin-Liang/data-centric-AI-perspective

Language: Jupyter Notebook - Size: 3.43 MB - Last synced at: about 1 year ago - Pushed at: over 3 years ago - Stars: 3 - Forks: 0

jameszhou-gl/icl-distribution-shift

Code for "Adapting Large Multimodal Models to Distribution Shifts: The Role of In-Context Learning"

Size: 1.95 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 0

wondergo2017/sild

Implementation codes for NeurIPS23 paper "Spectral Invariant Learning for Dynamic Graphs under Distribution Shifts"

Language: Python - Size: 2.29 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 0

estija/CMID

Code for the Conditional Mutual Information-Debiasing (CMID) method.

Language: Python - Size: 2.16 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

namkoong-lab/LLM-Tabular-Shifts

Code for "LLM Embeddings Improve Test-time Adaptation to Tabular Y|X-Shifts"

Language: Python - Size: 149 KB - Last synced at: 7 months ago - Pushed at: 8 months ago - Stars: 1 - Forks: 0

martinwimpff/eeg-online

Language: Python - Size: 519 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0

rgklab/detectron_xgb

Robust and Highly Sensitive Covariate Shift Detection using XGBoost

Language: Python - Size: 110 KB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

testing-cs/CodeS

Language: Python - Size: 47.9 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 1

VirtuosoResearch/Distribution-Shifts-in-CMNIST

Language: Python - Size: 502 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

HelloZicky/IntellectReq

[WWW2024 (Oral)] PyTorch implementation of "Intelligent Model Update Strategy for Sequential Recommendation".

Language: Python - Size: 373 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

ShahryarBQ/DRO

Coping with Label Shift via Distributionally Robust Optimisation

Language: Python - Size: 6.84 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

monk1337/Clift

CLIFT : Analysing Natural Distribution Shift on Question Answering Models in Clinical Domain

Size: 11.7 KB - Last synced at: 3 months ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

vijayakuruba/IFT6759_Distribution_shifts_WILDS

Course work project for IFT6759 - WILDS - Distribution shifts in wilds - iwildcam

Language: Jupyter Notebook - Size: 4.47 MB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 2