Implementation of Averaged Stochastic Gradient Descent for PyTorch. Two versions: 1. ASGD with fixed triggering point, 2. Non-monotonically triggered ASGD.
machine-learning deep-learning optimization optimizer pytorch regularization stochastic-gradient-descent asgd-optimizer
-
Updated
Sep 1, 2024 - Python