GitHub topics: sparse-training
ahmad-aloradi/adversarial-robustness-for-sr
This project is subproject of the COMFORT.
Language: Jupyter Notebook - Size: 5.66 MB - Last synced at: 3 days ago - Pushed at: 4 days ago - Stars: 1 - Forks: 0

Shiweiliuiiiiiii/In-Time-Over-Parameterization
[ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, Decebal Constantin Mocanu, Mykola Pechenizkiy
Language: Python - Size: 245 KB - Last synced at: 8 days ago - Pushed at: over 1 year ago - Stars: 45 - Forks: 6

google-research/rigl
End-to-end training of sparse deep neural networks with little-to-no performance loss.
Language: Python - Size: 811 KB - Last synced at: 15 days ago - Pushed at: about 2 years ago - Stars: 320 - Forks: 49

VITA-Group/SViTE
[NeurIPS'21] "Chasing Sparsity in Vision Transformers: An End-to-End Exploration" by Tianlong Chen, Yu Cheng, Zhe Gan, Lu Yuan, Lei Zhang, Zhangyang Wang
Language: Python - Size: 615 KB - Last synced at: 2 days ago - Pushed at: over 1 year ago - Stars: 89 - Forks: 12

VITA-Group/ToST
[ICML2022] Training Your Sparse Neural Network Better with Any Mask. Ajay Jaiswal, Haoyu Ma, Tianlong Chen, ying Ding, and Zhangyang Wang
Language: Python - Size: 71.3 KB - Last synced at: 2 days ago - Pushed at: over 2 years ago - Stars: 27 - Forks: 3

IGITUGraz/SparseAdversarialTraining
Code for "Training Adversarially Robust Sparse Networks via Bayesian Connectivity Sampling" [ICML 2021]
Language: Python - Size: 37.1 KB - Last synced at: 7 days ago - Pushed at: about 3 years ago - Stars: 10 - Forks: 1

Shiweiliuiiiiiii/Selfish-RNN
[ICML 2021] "Selfish Sparse RNN Training" by Shiwei Liu, Decebal Constantin Mocanu, Yulong Pei, Mykola Pechenizkiy
Language: Python - Size: 2 MB - Last synced at: 8 days ago - Pushed at: over 3 years ago - Stars: 10 - Forks: 3

ZIYU-DEEP/Generalization-and-Memorization-in-Sparse-Training
This is the repository for the SNN-22 Workshop paper on "Generalization and Memorization in Sparse Neural Networks".
Language: Python - Size: 6.08 MB - Last synced at: 2 days ago - Pushed at: about 2 years ago - Stars: 2 - Forks: 0

dcmocanu/sparse-evolutionary-artificial-neural-networks
Always sparse. Never dense. But never say never. A Sparse Training repository for the Adaptive Sparse Connectivity concept and its algorithmic instantiation, i.e. Sparse Evolutionary Training, to boost Deep Learning scalability on various aspects (e.g. memory and computational time efficiency, representation and generalization power).
Language: Python - Size: 67 MB - Last synced at: over 1 year ago - Pushed at: almost 4 years ago - Stars: 228 - Forks: 65

zahraatashgahi/QuickSelection
[Machine Learning Journal (ECML-PKDD 2022 journal track)] Quick and Robust Feature Selection: the Strength of Energy-efficient Sparse Training for Autoencoders
Language: Python - Size: 262 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 15 - Forks: 4

GhadaSokar/Dynamic-Sparse-Training-for-Deep-Reinforcement-Learning
[IJCAI 2022] "Dynamic Sparse Training for Deep Reinforcement Learning" by Ghada Sokar, Elena Mocanu , Decebal Constantin Mocanu, Mykola Pechenizkiy, and Peter Stone.
Language: Python - Size: 1.38 MB - Last synced at: almost 2 years ago - Pushed at: almost 3 years ago - Stars: 10 - Forks: 1

zahraatashgahi/NeuroFS
[TMLR] Supervised Feature Selection with Neuron Evolution in Sparse Neural Networks
Language: Python - Size: 1.15 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

zahraatashgahi/CTRE
[Machine Learning Journal (ECML-PKDD 2022 journal track)] A Brain-inspired Algorithm for Training Highly Sparse Neural Networks
Language: Python - Size: 56.6 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 1

GhadaSokar/SpaceNet
Implementation for the paper "SpaceNet: Make Free Space For Continual Learning" in PyTorch.
Language: Python - Size: 10.7 KB - Last synced at: almost 2 years ago - Pushed at: about 4 years ago - Stars: 8 - Forks: 0

A-Klass/torch_topkast
PyTorch Implementation of TopKAST
Language: Python - Size: 6.27 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 6 - Forks: 0
