Data

Tools

Indexes

Applications

Experiments

Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: adaptive-gradient-clipping

vballoli/nfnets-pytorch

NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch. Find explanation at tourdeml.github.io/blog/

Language: Python - Size: 5.63 MB - Last synced at: 18 days ago - Pushed at: over 1 year ago - Stars: 345 - Forks: 29

VITA-Group/BNN_NoBN

[CVPRW 21] "BNN - BN = ? Training Binary Neural Networks without Batch Normalization", Tianlong Chen, Zhenyu Zhang, Xu Ouyang, Zechun Liu, Zhiqiang Shen, Zhangyang Wang

Language: Python - Size: 310 KB - Last synced at: 7 days ago - Pushed at: over 3 years ago - Stars: 57 - Forks: 10

andreped/GradientAccumulator

:dart: Accumulated Gradients for TensorFlow 2

Language: Python - Size: 5.3 MB - Last synced at: 5 days ago - Pushed at: about 1 year ago - Stars: 53 - Forks: 11

Related Keywords
adaptive-gradient-clipping 3 deepmind 1 image-classification 1 nfnets 1 paper 1 pytorch 1 sgd 1 sota 1 batch-normalization 1 binary-neural-networks 1 normalization-free-training 1 normalizer-free 1 weight-standardization 1 accumulated-batch-normalization 1 accumulated-gradients 1 batch-size 1 deep-learning 1 distributed-training 1 float16 1 gpu 1 gradient-accumulation 1 hacktoberfest 1 huggingface 1 keras 1 memory-constraints 1 mixed-precision 1 multi-gpu 1 tensorflow 1 tensorflow2 1 tf2 1 tpu 1