Warmup learning rate wrapper for Pytorch Scheduler
-
Updated
Apr 12, 2020 - Python
#
learning-rate-warmup
Here are 5 public repositories matching this topic...
-
Updated
Apr 11, 2022
Comprehensive image classification for training multilayer perceptron (MLP), LeNet, LeNet5, conv2, conv4, conv6, VGG11, VGG13, VGG16, VGG19 with batch normalization, ResNet18, ResNet34, ResNet50, MobilNetV2 on MNIST, CIFAR10, CIFAR100, and ImageNet1K.
training logging pytorch hyperparameters mnist vgg sgd imagenet image-classification tensorboard resnet cifar adam distributed-training pytorch-implementation tensorboard-pytorch learning-rate-scheduling automatic-mixed-precision learning-rate-warmup small-convolutional
-
Updated
Oct 5, 2021 - Python
Learning-rate schedules from boundary-value constrained trust-region problems.
learning deep-learning optimizer energy-minimization step-size learning-rate-decay boundary-value-problem learning-rate-scheduling learning-rate-warmup trust-region-methods stochastic-gradient-method learning-rate-scheduler learning-rate-schedule
-
Updated
Sep 8, 2026 - Python
Provide a collection of flexible learning rate schedulers for PyTorch with presets, warmup wrappers, and research-based implementations.
deep-learning scheduler clr sam optimizer transformer muon large-scale-learning scion multinode lr triangular learning-rate-decay adamw cyclical-learning-rate radam learning-rate-warmup gradient-centralization adamp madgrad
-
Updated
Sep 22, 2026 - Python
Add this topic to your repo
To associate your repository with the learning-rate-warmup topic, visit your repo's landing page and select "manage topics."