JRC1995/DemonRangerOptimizer

Quasi Hyperbolic Rectified DEMON Adam/Amsgrad with AdaMod, Gradient Centralization, Lookahead, iterative averaging and decorrelated Weight Decay

Language: Python - Size: 166 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 23 - Forks: 6