An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: sparse-training

ahmad-aloradi/adversarial-robustness-for-sr

This project is subproject of the COMFORT.

Language: Jupyter Notebook - Size: 5.66 MB - Last synced at: 3 days ago - Pushed at: 4 days ago - Stars: 1 - Forks: 0

Shiweiliuiiiiiii/In-Time-Over-Parameterization

[ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, Decebal Constantin Mocanu, Mykola Pechenizkiy

Language: Python - Size: 245 KB - Last synced at: 8 days ago - Pushed at: over 1 year ago - Stars: 45 - Forks: 6

google-research/rigl

End-to-end training of sparse deep neural networks with little-to-no performance loss.

Language: Python - Size: 811 KB - Last synced at: 15 days ago - Pushed at: about 2 years ago - Stars: 320 - Forks: 49

VITA-Group/SViTE

[NeurIPS'21] "Chasing Sparsity in Vision Transformers: An End-to-End Exploration" by Tianlong Chen, Yu Cheng, Zhe Gan, Lu Yuan, Lei Zhang, Zhangyang Wang

Language: Python - Size: 615 KB - Last synced at: 2 days ago - Pushed at: over 1 year ago - Stars: 89 - Forks: 12

VITA-Group/ToST

[ICML2022] Training Your Sparse Neural Network Better with Any Mask. Ajay Jaiswal, Haoyu Ma, Tianlong Chen, ying Ding, and Zhangyang Wang

Language: Python - Size: 71.3 KB - Last synced at: 2 days ago - Pushed at: over 2 years ago - Stars: 27 - Forks: 3

IGITUGraz/SparseAdversarialTraining

Code for "Training Adversarially Robust Sparse Networks via Bayesian Connectivity Sampling" [ICML 2021]

Language: Python - Size: 37.1 KB - Last synced at: 7 days ago - Pushed at: about 3 years ago - Stars: 10 - Forks: 1

Shiweiliuiiiiiii/Selfish-RNN

[ICML 2021] "Selfish Sparse RNN Training" by Shiwei Liu, Decebal Constantin Mocanu, Yulong Pei, Mykola Pechenizkiy

Language: Python - Size: 2 MB - Last synced at: 8 days ago - Pushed at: over 3 years ago - Stars: 10 - Forks: 3

ZIYU-DEEP/Generalization-and-Memorization-in-Sparse-Training

This is the repository for the SNN-22 Workshop paper on "Generalization and Memorization in Sparse Neural Networks".

Language: Python - Size: 6.08 MB - Last synced at: 2 days ago - Pushed at: about 2 years ago - Stars: 2 - Forks: 0

dcmocanu/sparse-evolutionary-artificial-neural-networks

Always sparse. Never dense. But never say never. A Sparse Training repository for the Adaptive Sparse Connectivity concept and its algorithmic instantiation, i.e. Sparse Evolutionary Training, to boost Deep Learning scalability on various aspects (e.g. memory and computational time efficiency, representation and generalization power).

Language: Python - Size: 67 MB - Last synced at: over 1 year ago - Pushed at: almost 4 years ago - Stars: 228 - Forks: 65

zahraatashgahi/QuickSelection

[Machine Learning Journal (ECML-PKDD 2022 journal track)] Quick and Robust Feature Selection: the Strength of Energy-efficient Sparse Training for Autoencoders

Language: Python - Size: 262 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 15 - Forks: 4

GhadaSokar/Dynamic-Sparse-Training-for-Deep-Reinforcement-Learning

[IJCAI 2022] "Dynamic Sparse Training for Deep Reinforcement Learning" by Ghada Sokar, Elena Mocanu , Decebal Constantin Mocanu, Mykola Pechenizkiy, and Peter Stone.

Language: Python - Size: 1.38 MB - Last synced at: almost 2 years ago - Pushed at: almost 3 years ago - Stars: 10 - Forks: 1

zahraatashgahi/NeuroFS

[TMLR] Supervised Feature Selection with Neuron Evolution in Sparse Neural Networks

Language: Python - Size: 1.15 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

zahraatashgahi/CTRE

[Machine Learning Journal (ECML-PKDD 2022 journal track)] A Brain-inspired Algorithm for Training Highly Sparse Neural Networks

Language: Python - Size: 56.6 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 1

GhadaSokar/SpaceNet

Implementation for the paper "SpaceNet: Make Free Space For Continual Learning" in PyTorch.

Language: Python - Size: 10.7 KB - Last synced at: almost 2 years ago - Pushed at: about 4 years ago - Stars: 8 - Forks: 0

A-Klass/torch_topkast

PyTorch Implementation of TopKAST

Language: Python - Size: 6.27 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 6 - Forks: 0