Cover Image

Delayed supermartingale convergence lemmas for stochastic approximation with Nesterov momentum

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Ming-Kun, Zhang
Format:	Preprint
Published:	2024
Subjects:	Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Nesterov Acceleration with Operator Decomposition
by: Lee, Jaewook, et al.
Published: (2026)

An abstract effective convergence theorem for stochastic processes, with applications to stochastic approximation
by: Neri, Morenikeji, et al.
Published: (2025)

Proximal gradient-type method with generalized distance and convergence analysis without global descent lemma
by: Yagishita, Shotaro, et al.
Published: (2025)

EMA-Nesterov: Stabilizing Nesterov's Lookahead for Accelerated Deep Learning Optimization
by: Yau, Chung-Yiu, et al.
Published: (2026)

Continuized Nesterov Acceleration for Non-Convex Optimization
by: Hermant, Julien, et al.
Published: (2025)

Nesterov Accelerated Distributed Optimization with Efficient Quantized Communication
by: Wu, Ruochen, et al.
Published: (2026)

Multi-cut stochastic approximation methods for solving stochastic convex composite optimization
by: Liang, Jiaming, et al.
Published: (2025)

Faster stochastic cubic regularized Newton methods with momentum
by: Yang, Yiming, et al.
Published: (2025)

The Iterates of Nesterov's Accelerated Algorithm Converge in The Critical Regimes
by: Bot, Radu Ioan, et al.
Published: (2025)

On adaptive stochastic heavy ball momentum for solving linear systems
by: Zeng, Yun, et al.
Published: (2023)

Convergence of projected stochastic approximation algorithm
by: Borowski, Michał, et al.
Published: (2025)

Accelerated linearized alternating direction method of multipliers with Nesterov extrapolation
by: He, X., et al.
Published: (2023)

On the Instability of Nesterov's ODE under Non-Conservative Vector Fields
by: Ochoa, Daniel E., et al.
Published: (2025)

Optimal local linear convergence of Nesterov's accelerated gradient method for $C^2$ functions under the Polyak--Łojasiewicz inequality
by: Feng, Zixu, et al.
Published: (2026)

Almost sure convergence of stochastic Hamiltonian descent methods
by: Williamson, Måns, et al.
Published: (2024)

On rates of convergence for sample average approximations without smoothness
by: Nguyen, Hien Duy, et al.
Published: (2026)

Nesterov Flow May Travel Infinitely Long to Converge to a Minimizer
by: Ryu, Ernest K.
Published: (2026)

An Adaptive and Parameter-Free Nesterov's Accelerated Gradient Method for Convex Optimization
by: Suh, Jaewook J., et al.
Published: (2025)

Point Convergence of Nesterov's Accelerated Gradient Method: An AI-Assisted Proof
by: Jang, Uijeong, et al.
Published: (2025)

Heavy Ball and Nesterov Accelerations with Hessian-driven Damping for Nonconvex Optimization
by: Hadjisavvas, N., et al.
Published: (2025)

Bessel Function Analysis of Nesterov's ODE in $N$-Player Quadratic Games
by: Paek, Jay
Published: (2026)

Weak convergence of the stochastic proximal point method in metric spaces
by: Pischke, Nicholas
Published: (2026)

On the convergence of doubly stochastic Primal-Dual Hybrid Gradient Method
by: Xiao, Yiheng, et al.
Published: (2026)

A Nesterov-style Accelerated Gradient Descent Algorithm for the Symmetric Eigenvalue Problem
by: Alimisis, Foivos, et al.
Published: (2024)

A Nesterov-Accelerated Primal-Dual Splitting Algorithm for Convex Nonsmooth Optimization
by: Condat, Laurent, et al.
Published: (2026)

The Nesterov-Spokoiny Acceleration Achieves Strict $o(1/k^2)$ Convergence
by: Peng, Weibin, et al.
Published: (2023)

Nesterov acceleration in benignly non-convex landscapes
by: Gupta, Kanan, et al.
Published: (2024)

Fractional-Order Nesterov Dynamics for Convex Optimization
by: Ranoto, Tumelo
Published: (2025)

Technical Report: A Totally Asynchronous Nesterov's Accelerated Gradient Method for Convex Optimization
by: Pond, Ellie, et al.
Published: (2024)

Nonconvex optimization and convergence of stochastic gradient descent, and solution of asynchronous game
by: Buck, Kevin, et al.
Published: (2025)

On the convergence rates of moment-SOS hierarchies approximation of truncated moment sequences
by: Tran, Hoang Anh, et al.
Published: (2025)

From Halpern's Fixed-Point Iterations to Nesterov's Accelerated Interpretations for Root-Finding Problems
by: Tran-Dinh, Quoc
Published: (2022)

A Concise Lyapunov Analysis of Nesterov's Accelerated Gradient Method
by: Liu, Jun
Published: (2025)

Impulse approximate controllability for stochastic evolution equations and its applications
by: Liu, Yuanhang
Published: (2024)

A kernel-based stochastic approximation framework for contextual optimization
by: Cao, Hao, et al.
Published: (2025)

Two-norm discrepancy and convergence of the stochastic gradient method with application to shape optimization
by: Dambrine, Marc, et al.
Published: (2024)

Extremum seeking with exponential convergence via high-order Lie bracket approximations
by: Grushkovskaya, Victoria, et al.
Published: (2026)

Continuized Nesterov Momentum Achieves the $O(\varepsilon^{-7/4})$ Complexity without Additional Mechanisms
by: Hermant, Julien, et al.
Published: (2026)

Nesterov Acceleration for Ensemble Kalman Inversion and Variants
by: Vernon, Sydney, et al.
Published: (2025)

Study of the behaviour of Nesterov Accelerated Gradient in a non convex setting: the strongly quasar convex case
by: Hermant, Julien, et al.
Published: (2024)