Cover Image

Complexity of normalized stochastic first-order methods with momentum under heavy-tailed noise

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	He, Chuan, Lu, Zhaosong, Sun, Defeng, Deng, Zhanwang
Format:	Preprint
Published:	2025
Subjects:	Optimization and Control Artificial Intelligence Computational Complexity Machine Learning 49M05, 49M37, 90C25, 90C30
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Accelerated stochastic first-order method for convex optimization under heavy-tailed noise
by: He, Chuan, et al.
Published: (2025)

Low-rank Orthogonalization for Large-scale Matrix Optimization with Applications to Foundation Model Training
by: He, Chuan, et al.
Published: (2025)

A stochastic first-order method with multi-extrapolated momentum for highly smooth unconstrained optimization
by: He, Chuan
Published: (2024)

On the resolution of $\ell_1$-norm minimization via a two-metric adaptive projection method
by: Wu, Hanju, et al.
Published: (2025)

On the Convergence and Complexity of Proximal Gradient and Accelerated Proximal Gradient Methods under Adaptive Gradient Estimation
by: Bollapragada, Raghu, et al.
Published: (2025)

A Newton-CG based barrier-augmented Lagrangian method for general nonconvex conic optimization
by: He, Chuan, et al.
Published: (2023)

Retrospective Approximation Sequential Quadratic Programming for Stochastic Optimization with General Deterministic Nonlinear Constraints
by: Berahas, Albert S., et al.
Published: (2025)

A cut-and-project perspective for linearized Bregman iterations
by: Dai, Yu-Hong, et al.
Published: (2024)

Exploiting cone approximations in an augmented Lagrangian method for conic optimization
by: Fukuda, Mituhiro, et al.
Published: (2024)

Augmented Lagrangian methods for fully convex composite optimization
by: De Marchi, Alberto, et al.
Published: (2025)

The Grimmer--Shu--Wang Certificate and the Drori--Teboulle Minimax Constant-Stepsize Bound for $N\ge 3$
by: Zhang, Lixing
Published: (2026)

MGProx: A nonsmooth multigrid proximal gradient method with adaptive restriction for strongly convex optimization
by: Ang, Andersen, et al.
Published: (2023)

Bias-Variance Trade-off for Clipped Stochastic First-Order Methods: From Bounded Variance to Infinite Mean
by: He, Chuan
Published: (2025)

Modified limited memory BFGS with displacement aggregation and its application to the largest eigenvalue problem
by: Sahu, Manish Kumar, et al.
Published: (2023)

Switching Point Optimization for Abstract Parabolic Equations
by: Buchheim, Christoph, et al.
Published: (2026)

Variational Poisson Denoising via Augmented Lagrangian Methods
by: Kanzow, Christian, et al.
Published: (2023)

A Proximal Stochastic Gradient Method with Adaptive Step Size and Variance Reduction for Convex Composite Optimization
by: Fang, Changjie, et al.
Published: (2025)

On the Convergence Rates of Iterative Regularization Algorithms for Composite Bi-Level Optimization
by: Shtern, Shimrit, et al.
Published: (2025)

Flexible block-iterative analysis for the Frank-Wolfe algorithm
by: Braun, Gábor, et al.
Published: (2024)

Level Constrained First Order Methods for Function Constrained Optimization
by: Boob, Digvijay, et al.
Published: (2022)

Parallel block coordinate descent methods with identification strategies
by: Lopes, Ronaldo, et al.
Published: (2025)

Cubic Regularization Technique of the Newton Method for Vector Optimization
by: Ghosh, Debdas
Published: (2025)

Dual dynamic programming for stochastic programs over an infinite horizon
by: Ju, Caleb, et al.
Published: (2023)

First- and Second-Order Stochastic Adaptive Regularization with Cubics: High Probability Iteration and Sample Complexity
by: Scheinberg, Katya, et al.
Published: (2023)

Vector-Valued Integer Optimal Control with TV Regularization: Optimality Conditions and Algorithmic Treatment
by: Marko, Jonas, et al.
Published: (2024)

Integer optimal control problems with total variation regularization: Optimality conditions and fast solution of subproblems
by: Marko, Jonas, et al.
Published: (2022)

Subgradient Methods on Manifolds with Lower Bounded Curvature
by: Bento, G. C., et al.
Published: (2026)

Complexity of an inexact stochastic SQP algorithm for equality constrained optimization
by: O'Neill, Michael J., et al.
Published: (2026)

Exact Continuous Reformulations of Logic Constraints in Nonlinear Optimization and Optimal Control Problems
by: Wehbeh, Jad, et al.
Published: (2026)

Alternating Gradient-Type Algorithm for Bilevel Optimization with Inexact Lower-Level Solutions via Moreau Envelope-based Reformulation
by: Bai, Xiaoning, et al.
Published: (2024)

Modified parameter of Dai Liao conjugacy condition of the conjugate gradient method
by: Alhawarat, Ahmad
Published: (2023)

A trust-region method for optimal control of ODEs with continuous-or-off controls and TV regularization
by: Friedemann, Markus, et al.
Published: (2025)

Trust-Region Method for Optimization of Set-Valued Maps Given by Finitely Many Functions
by: Ghosh, Suprova, et al.
Published: (2025)

On the Convergence of Interior-Point Methods for Bound-Constrained Nonlinear Optimization Problems with Noise
by: Dezfulian, Shima, et al.
Published: (2024)

Local Convergence Results for Sequential Quadratic Programming with Complementarity Constraints
by: Nurkanović, Armin
Published: (2026)

A Globally Convergent Method for Computing B-stationary Points of Mathematical Programs with Equilibrium Constraints
by: Nurkanović, Armin, et al.
Published: (2025)

On Discrete Subproblems in Integer Optimal Control with Total Variation Regularization in Two Dimensions
by: Manns, Paul, et al.
Published: (2024)

A Newton Augmented Lagrangian Method for Symmetric Cone Programming with Complexity Analysis
by: Zhang, Rui-Jin, et al.
Published: (2025)

First-order majorization-minimization meets high-order majorant: Boosted inexact high-order forward-backward method
by: Kabgani, Alireza, et al.
Published: (2025)

Continuous-Time Dynamics of the Difference-of-Convex Algorithm
by: Niu, Yi-Shuai
Published: (2026)