Cover Image

Provable Acceleration of Nesterov's Accelerated Gradient Method over Heavy Ball Method in Training Over-Parameterized Neural Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liu, Xin, Tao, Wei, Li, Wei, Zhan, Dazhi, Wang, Jun, Pan, Zhisong
Format:	Preprint
Published:	2022
Subjects:	Machine Learning Artificial Intelligence Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Provable Acceleration of Nesterov's Accelerated Gradient for Rectangular Matrix Factorization and Linear Neural Networks
by: Xu, Zhenghao, et al.
Published: (2024)

Accelerated Over-Relaxation Heavy-Ball Method: Achieving Global Accelerated Convergence with Broad Generalization
by: Wei, Jingrong, et al.
Published: (2024)

A Concise Lyapunov Analysis of Nesterov's Accelerated Gradient Method
by: Liu, Jun
Published: (2025)

Heavy Ball and Nesterov Accelerations with Hessian-driven Damping for Nonconvex Optimization
by: Hadjisavvas, N., et al.
Published: (2025)

Accelerated Convergence of Stochastic Heavy Ball Method under Anisotropic Gradient Noise
by: Pan, Rui, et al.
Published: (2023)

An Adaptive and Parameter-Free Nesterov's Accelerated Gradient Method for Convex Optimization
by: Suh, Jaewook J., et al.
Published: (2025)

Point Convergence of Nesterov's Accelerated Gradient Method: An AI-Assisted Proof
by: Jang, Uijeong, et al.
Published: (2025)

Generalized Continuous-Time Models for Nesterov's Accelerated Gradient Methods
by: Park, Chanwoong, et al.
Published: (2024)

Provable Accelerated Convergence of Nesterov's Momentum for Deep ReLU Neural Networks
by: Liao, Fangshuo, et al.
Published: (2023)

Technical Report: A Totally Asynchronous Nesterov's Accelerated Gradient Method for Convex Optimization
by: Pond, Ellie, et al.
Published: (2024)

Inference of Online Newton Methods with Nesterov's Accelerated Sketching
by: Wang, Haoxuan, et al.
Published: (2026)

Nesterov Acceleration with Operator Decomposition
by: Lee, Jaewook, et al.
Published: (2026)

Accelerated Gradient Methods Through Variable and Operator Splitting
by: Chen, Long, et al.
Published: (2025)

A Nesterov-style Accelerated Gradient Descent Algorithm for the Symmetric Eigenvalue Problem
by: Alimisis, Foivos, et al.
Published: (2024)

Scaled Proximal Gradient Methods for Multiobjective Optimization: Improved Linear Convergence and Nesterov's Acceleration
by: Chen, Jian, et al.
Published: (2024)

Continuized Nesterov Acceleration for Non-Convex Optimization
by: Hermant, Julien, et al.
Published: (2025)

A Note on the Gradient-Evaluation Sequence in Accelerated Gradient Methods
by: Wu, Yan, et al.
Published: (2026)

Nesterov Accelerated Distributed Optimization with Efficient Quantized Communication
by: Wu, Ruochen, et al.
Published: (2026)

EMA-Nesterov: Stabilizing Nesterov's Lookahead for Accelerated Deep Learning Optimization
by: Yau, Chung-Yiu, et al.
Published: (2026)

The Iterates of Nesterov's Accelerated Algorithm Converge in The Critical Regimes
by: Bot, Radu Ioan, et al.
Published: (2025)

(Accelerated) Noise-adaptive Stochastic Heavy-Ball Momentum
by: Dang, Anh, et al.
Published: (2024)

Relaxed Weak Accelerated Proximal Gradient Method: a Unified Framework for Nesterov's Accelerations
by: Li, Hongda, et al.
Published: (2025)

Study of the behaviour of Nesterov Accelerated Gradient in a non convex setting: the strongly quasar convex case
by: Hermant, Julien, et al.
Published: (2024)

Accelerated linearized alternating direction method of multipliers with Nesterov extrapolation
by: He, X., et al.
Published: (2023)

Accelerated Proximal Gradient Method with Backtracking for Multiobjective Optimization
by: Huang, Chengzhi, et al.
Published: (2024)

Adaptive Accelerated Gradient Method for Smooth Convex Optimization
by: Wang, Zepeng, et al.
Published: (2025)

Adaptive Accelerated Gradient Descent Methods for Convex Optimization
by: Xu, Zeyi, et al.
Published: (2026)

The Nesterov-Spokoiny Acceleration Achieves Strict $o(1/k^2)$ Convergence
by: Peng, Weibin, et al.
Published: (2023)

Accelerated Stochastic Gradient Method with Applications to Consensus Problem in Markov-Varying Networks
by: Solodkin, Vladimir, et al.
Published: (2024)

Nesterov Finds GRAAL: Optimal and Adaptive Gradient Method for Convex Optimization
by: Borodich, Ekaterina, et al.
Published: (2025)

Convergence Rate Analysis for Monotone Accelerated Proximal Gradient Method
by: Wang, Zepeng, et al.
Published: (2025)

Towards Simple and Provable Parameter-Free Adaptive Gradient Methods
by: Tao, Yuanzhe, et al.
Published: (2024)

Nesterov Acceleration for Ensemble Kalman Inversion and Variants
by: Vernon, Sydney, et al.
Published: (2025)

Accelerated Alternating Direction Method of Multipliers Gradient Tracking for Distributed Optimization
by: Sebastián, Eduardo, et al.
Published: (2024)

A Nesterov-Accelerated Primal-Dual Splitting Algorithm for Convex Nonsmooth Optimization
by: Condat, Laurent, et al.
Published: (2026)

Accelerated Gradient Methods via Inertial Systems with Hessian-driven Damping
by: Wang, Zepeng, et al.
Published: (2025)

Smoothing Accelerated Proximal Gradient Method with Backtracking for Nonsmooth Multiobjective Optimization
by: Chengzhi, Huang
Published: (2025)

Convergence Analysis of Stochastic Accelerated Gradient Methods for Generalized Smooth Optimizations
by: Yu, Chenhao, et al.
Published: (2025)

Deterministic and Stochastic Accelerated Gradient Method for Convex Semi-Infinite Optimization
by: Yao, Yao, et al.
Published: (2023)

From Halpern's Fixed-Point Iterations to Nesterov's Accelerated Interpretations for Root-Finding Problems
by: Tran-Dinh, Quoc
Published: (2022)