Gradient correlation is a key ingredient to accelerate SGD with momentum

Documenti analoghi

• Study of the behaviour of Nesterov Accelerated Gradient in a non convex setting: the strongly quasar convex case
  di: Hermant, Julien, et al.
  Pubblicazione: (2024)
• Continuized Nesterov Acceleration for Non-Convex Optimization
  di: Hermant, Julien, et al.
  Pubblicazione: (2025)
• Continuized Nesterov Momentum Achieves the $O(\varepsilon^{-7/4})$ Complexity without Additional Mechanisms
  di: Hermant, Julien, et al.
  Pubblicazione: (2026)
• Strong Convergence of FISTA Iterates under H{ö}lderian and Quadratic Growth Conditions
  di: Aujol, Jean-François, et al.
  Pubblicazione: (2024)
• Heavy Ball Momentum for Non-Strongly Convex Optimization
  di: Aujol, Jean-François, et al.
  Pubblicazione: (2024)