Acceleration of stochastic gradient descent with momentum by averaging: finite-sample rates and asymptotic normality

Documenti analoghi

• Exponential convergence rates for momentum stochastic gradient descent in the overparametrized setting
  di: Gess, Benjamin, et al.
  Pubblicazione: (2023)
• Unbiased least squares regression via averaged stochastic gradient descent
  di: Kahalé, Nabil
  Pubblicazione: (2024)
• Learning single index model with gradient descent: spectral initialization and precise asymptotics
  di: Chen, Yuchen, et al.
  Pubblicazione: (2025)
• New logarithmic step size for stochastic gradient descent
  di: Shamaee, M. Soheil, et al.
  Pubblicazione: (2024)
• Natural gradient descent with momentum
  di: Nouy, Anthony, et al.
  Pubblicazione: (2026)