learning-rate-scheduling | Topic

Topic: "learning-rate-scheduling"

Tony-Y/pytorch_warmup

Learning Rate Warmup in PyTorch

Language: Python - Size: 7.18 MB - Last synced at: 27 days ago - Pushed at: 3 months ago - Stars: 410 - Forks: 24

kozistr/pytorch_optimizer

optimizer & lr scheduler & loss function collections in PyTorch

Language: Python - Size: 287 MB - Last synced at: 2 days ago - Pushed at: 7 days ago - Stars: 305 - Forks: 24

awslabs/adatune

Gradient based Hyperparameter Tuning library in PyTorch

Language: Python - Size: 979 KB - Last synced at: 29 days ago - Pushed at: almost 5 years ago - Stars: 290 - Forks: 32

cmpark0126/pytorch-polynomial-lr-decay

Polynomial Learning Rate Decay Scheduler for PyTorch

Language: Python - Size: 10.7 KB - Last synced at: 2 months ago - Pushed at: over 3 years ago - Stars: 65 - Forks: 13

Lance0218/Pytorch-DistributedDataParallel-Training-Tricks

A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stopping and random seed.

Language: Python - Size: 101 MB - Last synced at: over 2 years ago - Pushed at: about 3 years ago - Stars: 45 - Forks: 8

YuchenJin/autolrs

Automatic learning-rate scheduler

Language: Python - Size: 4.21 MB - Last synced at: 7 months ago - Pushed at: about 4 years ago - Stars: 44 - Forks: 8

abhuse/cyclic-cosine-decay

Pytorch cyclic cosine decay learning rate scheduler

Language: Jupyter Notebook - Size: 426 KB - Last synced at: over 2 years ago - Pushed at: about 4 years ago - Stars: 39 - Forks: 7

lehduong/torch-warmup-lr

Warmup learning rate wrapper for Pytorch Scheduler

Language: Python - Size: 25.4 KB - Last synced at: over 2 years ago - Pushed at: about 5 years ago - Stars: 33 - Forks: 4

TheQuantScientist/LiteFormer

[EAAI] The official repo for the paper: "A Lightweight Multi-Head Attention Transformer for Stock Price Forecasting".

Language: Jupyter Notebook - Size: 64.7 MB - Last synced at: 8 days ago - Pushed at: 30 days ago - Stars: 21 - Forks: 5

git-disl/LRBench

A learning rate recommending and benchmarking tool.

Language: Python - Size: 11.1 MB - Last synced at: 10 months ago - Pushed at: about 2 years ago - Stars: 19 - Forks: 1

ahundt/sharpDARTS

sharpDARTS: Faster and More Accurate Differentiable Architecture Search

Language: Python - Size: 6.31 MB - Last synced at: 2 months ago - Pushed at: over 4 years ago - Stars: 16 - Forks: 4

JonnoFTW/keras_find_lr_on_plateau

Keras Callback to Automatically Adjust the learning rate when it stops improving

Language: Python - Size: 21.5 KB - Last synced at: about 1 month ago - Pushed at: almost 6 years ago - Stars: 16 - Forks: 4

timesler/lr-momentum-scheduler

Pytorch implementation of arbitrary learning rate and momentum schedules, including the One Cycle Policy

Language: Python - Size: 17.6 KB - Last synced at: about 2 months ago - Pushed at: almost 5 years ago - Stars: 12 - Forks: 1

ZIB-IOL/BIMP

Code to reproduce the experiments of ICLR2023-paper: How I Learned to Stop Worrying and Love Retraining

Language: Python - Size: 60.5 KB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 8 - Forks: 0

developer0hye/Learning-Rate-WarmUp

Size: 40 KB - Last synced at: over 2 years ago - Pushed at: about 3 years ago - Stars: 8 - Forks: 3

cybertronai/pytorch-fd

Implementation of fluctuation dissipation relations for automatic learning rate annealing.

Language: Python - Size: 1.08 MB - Last synced at: 2 months ago - Pushed at: almost 6 years ago - Stars: 8 - Forks: 0

nomuramasahir0/cma-learning-rate-adaptation

(GECCO2023 Best Paper Nomination & ACM TELO) CMA-ES with Learning Rate Adaptation

Language: Python - Size: 2.22 MB - Last synced at: 20 days ago - Pushed at: 20 days ago - Stars: 4 - Forks: 0

Comprehensive image classification for training multilayer perceptron (MLP), LeNet, LeNet5, conv2, conv4, conv6, VGG11, VGG13, VGG16, VGG19 with batch normalization, ResNet18, ResNet34, ResNet50, MobilNetV2 on MNIST, CIFAR10, CIFAR100, and ImageNet1K.

Language: Python - Size: 46.1 MB - Last synced at: 2 months ago - Pushed at: over 3 years ago - Stars: 4 - Forks: 0

hazmicokro/Image-Classification-Rock-Paper-Scissors-with-Model-Deployment

Submission Akhir - Image Classification Model Deployment - Belajar Pengembangan Machine Learning - Dicoding

Language: Jupyter Notebook - Size: 16.8 MB - Last synced at: over 2 years ago - Pushed at: over 4 years ago - Stars: 4 - Forks: 3

vballoli/abel-pytorch

ABEL implemented in PyTorch

Language: Python - Size: 5.55 MB - Last synced at: 3 months ago - Pushed at: about 3 years ago - Stars: 3 - Forks: 1

iSiddharth20/DeepLearning-ImageClassification-Toolkit

End-to-end Image Classification using Deep Learning toolkit for custom image datasets. Features include Pre-Processing, Training with Multiple CNN Architectures and Statistical Inference Tools. Special utilities for RAM optimization, Learning Rate Scheduling, and Detailed Code Comments are included.

Language: Jupyter Notebook - Size: 1.3 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 1

KhoiDOO/tvlars

TVLARS - A Fast Convergence Optimizer for Large Batch Training

Language: Python - Size: 1.1 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

rharish101/multistage-step-size-scheduling-minimax 📦

Master's thesis: Experiments on multistage step size schedulers for first-order optimization in minimax problems

Language: Python - Size: 373 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

razamehar/Weather-Time-Series-Analysis-using-Statistical-Methods-and-Deep-Learning-Models

This project conducts a thorough analysis of weather time series data using diverse statistical and deep learning models. Each model was rigorously applied to the same weather time series data to assess and compare their forecasting accuracy. Detailed results and analyses are provided to delineate the strengths and weaknesses of each approach.

Language: Jupyter Notebook - Size: 4.22 MB - Last synced at: 4 days ago - Pushed at: 10 months ago - Stars: 1 - Forks: 0