Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: hd-sgd

JRC1995/DemonRangerOptimizer

Quasi Hyperbolic Rectified DEMON Adam/Amsgrad with AdaMod, Gradient Centralization, Lookahead, iterative averaging and decorrelated Weight Decay

Language: Python - Size: 166 KB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 23 - Forks: 6

Related Keywords
adam 1 adamod 1 adamw 1 adaptive-optimizer 1 amsgrad 1 decay-momentum 1 demon 1 gradient-centralization 1 hd-adam 1 hd-sgd 1 hypergradient-descent 1 iterate-averaging 1 lookahead 1 nosadam 1 nostalgic-adam 1 optimizer 1 qhadam 1 qhranger 1 radam 1 ranger 1