GitHub topics: adan
kozistr/pytorch_optimizer
optimizer & lr scheduler & loss function collections in PyTorch
Language: Python - Size: 287 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 296 - Forks: 24
sail-sg/Adan
Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
Language: Python - Size: 1.3 MB - Last synced at: about 2 months ago - Pushed at: 11 months ago - Stars: 784 - Forks: 67
Related Keywords
pytorch
2
optimizer
2
adan
2
deep-learning
2
artificial-intelligence
1
bert-model
1
convnext
1
cuda-programming
1
diffusion
1
dreamfusion
1
fairseq
1
gpt2
1
llm-training
1
llms
1
mae
1
moe
1
resnet
1
timm
1
transformer-xl
1
vit
1
sam
1
ranger
1
radam
1
nero
1
madgrad
1
loss-functions
1
lookahead
1
learning-rate-scheduling
1
gradient-centralization
1
diffgrad
1
ademamix
1
adamp
1
adamd
1
adai
1
adabound
1
adabelief
1