Data

Tools

Indexes

Applications

Experiments

Repos

An open API service providing repository metadata for many open source software ecosystems.

Topic: "overparameterization"

Shiweiliuiiiiiii/In-Time-Over-Parameterization

[ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, Decebal Constantin Mocanu, Mykola Pechenizkiy

Language: Python - Size: 245 KB - Last synced at: 1 day ago - Pushed at: over 1 year ago - Stars: 45 - Forks: 6

nplotko/double-descent-lr

This project outlines 4 experiments to explore the effects of several settings on the bias-variance tradeoff curve

Language: Jupyter Notebook - Size: 2.22 MB - Last synced at: 8 months ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

MohammadSadeghSalehi/Overparametetization

Numerical experiments of the paper "On the Optimization of Deep Networks: Implicit Acceleration by Overparameterization, https://doi.org/10.48550/arXiv.1802.06509". The Neural networks have been implemented by PyTorch and TensorFlow

Language: Jupyter Notebook - Size: 116 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

Related Topics
deep-learning 2 sparsity 1 sparse-training 1 over-parameterization 1 in-time-overparameterization 1 in-time-over-parameterization 1 generalization 1 dynamic-sparse-training 1 regression 1 machine-learning 1 linear-regression 1 gpu 1 double-descent 1 torchvision 1 tensorflow 1 pytorch 1 matplotlib 1 fasionmnist 1 deep-neural-networks 1 cifar10 1