Data

Tools

Indexes

Applications

Experiments

Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: over-parameterization

Shiweiliuiiiiiii/In-Time-Over-Parameterization

[ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, Decebal Constantin Mocanu, Mykola Pechenizkiy

Language: Python - Size: 245 KB - Last synced at: about 2 months ago - Pushed at: about 2 years ago - Stars: 45 - Forks: 6

wy1iu/OPT

Implementation for <Orthogonal Over-Parameterized Training> in CVPR'21.

Language: Python - Size: 933 KB - Last synced at: 7 months ago - Pushed at: over 4 years ago - Stars: 19 - Forks: 2

rom1mouret/exploration

over-parameterization = exploration ?

Language: Python - Size: 81.1 KB - Last synced at: almost 2 years ago - Pushed at: over 5 years ago - Stars: 1 - Forks: 0

Related Keywords
deep-learning 1 dynamic-sparse-training 1 generalization 1 in-time-over-parameterization 1 in-time-overparameterization 1 overparameterization 1 sparse-training 1 sparsity 1 energy 1 hypersphere 1 hypersphereical-learning 1 neural-network 1 orthogonal 1 training 1 visual-recognition 1 exploration-exploitation 1 global-optimization 1 gradient-descent 1 hypernetworks 1