A unified convergence theory for adaptive first-order methods in the nonconvex case, including AdaNorm, full and diagonal AdaGrad, Shampoo and Muo

Documenti analoghi

• Stochastic convergence of parallel asynchronous adaptive first-order methods
  di: Gratton, Serge, et al.
  Pubblicazione: (2026)
• Complexity and performance for two classes of noise-tolerant first-order algorithms
  di: Gratton, S., et al.
  Pubblicazione: (2022)
• Complexity of Adagrad and other first-order methods for nonconvex optimization problems with bounds constraints
  di: Gratton, Serge, et al.
  Pubblicazione: (2024)
• OPM, a collection of Optimization Problems in Matlab
  di: Gratton, Serge, et al.
  Pubblicazione: (2021)
• Stability and convergence analysis of AdaGrad for non-convex optimization via novel stopping time-based techniques
  di: Jin, Ruinan, et al.
  Pubblicazione: (2024)