Provable Acceleration of Nesterov's Accelerated Gradient Method over Heavy Ball Method in Training Over-Parameterized Neural Networks

Documenti analoghi

• Provable Acceleration of Nesterov's Accelerated Gradient for Rectangular Matrix Factorization and Linear Neural Networks
  di: Xu, Zhenghao, et al.
  Pubblicazione: (2024)
• Accelerated Over-Relaxation Heavy-Ball Method: Achieving Global Accelerated Convergence with Broad Generalization
  di: Wei, Jingrong, et al.
  Pubblicazione: (2024)
• A Concise Lyapunov Analysis of Nesterov's Accelerated Gradient Method
  di: Liu, Jun
  Pubblicazione: (2025)
• Heavy Ball and Nesterov Accelerations with Hessian-driven Damping for Nonconvex Optimization
  di: Hadjisavvas, N., et al.
  Pubblicazione: (2025)
• Accelerated Convergence of Stochastic Heavy Ball Method under Anisotropic Gradient Noise
  di: Pan, Rui, et al.
  Pubblicazione: (2023)