Cover Image

Handbook of Convergence Theorems for (Stochastic) Gradient Methods

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Garrigos, Guillaume, Gower, Robert M.
Format:	Preprint
Published:	2023
Subjects:	Optimization and Control 65K05, 68T99 G.1.6
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

S2MPJ and CUTEst optimization problems for Matlab, Python and Julia
by: Gratton, Serge, et al.
Published: (2024)

Data-Dependent Complexity of First-Order Methods for Binary Classification
by: Hough, Matthew, et al.
Published: (2025)

A Primal-Dual Frank-Wolfe Algorithm for Linear Programming
by: Hough, Matthew, et al.
Published: (2024)

The ensmallen library for flexible numerical optimization
by: Curtin, Ryan R., et al.
Published: (2021)

Cubic Regularized Newton Method with Variance Reduction for Finite-sum Non-convex Problems
by: Pasechnyuk-Vilensky, Dmitry, et al.
Published: (2025)

Majorization-Minimization-Based Levenberg--Marquardt Method for Constrained Nonlinear Least Squares
by: Marumo, Naoki, et al.
Published: (2020)

Where's Ben Nevis? A 2D optimisation benchmark with 957,174 local optima based on Great Britain terrain data
by: Wei, Yuhang, et al.
Published: (2024)

Projections onto Spectral Matrix Cones
by: Cederberg, Daniel, et al.
Published: (2025)

Adaptive Stochastic Gradient Descent Ascent Algorithm for Nonconvex Minimax Problems with Decision-Dependent Distributions
by: Gao, Yan, et al.
Published: (2025)

Heterogeneous-Horizon Exact-Weight Local SGD
by: Pasechnyuk-Vilensky, Dmitry, et al.
Published: (2026)

Decentralised convex optimisation with probability-proportional-to-size quantization
by: Pasechniuk, Dmitrii, et al.
Published: (2025)

A three-step framework for noisy image segmentation in brain MRI
by: Antonelli, Laura, et al.
Published: (2025)

An optimally fast objective-function-free minimization algorithm using random subspaces
by: Bellavia, S., et al.
Published: (2023)

Stochastic Multiresolution Image Sketching for Inverse Imaging Problems
by: Perelli, Alessandro, et al.
Published: (2024)

A Stochastic Objective-Function-Free Adaptive Regularization Method with Optimal Complexity
by: Gratton, Serge, et al.
Published: (2024)

IPAS: An Adaptive Sample Size Method for Weighted Finite Sum Problems with Linear Equality Constraints
by: Krejić, Nataša, et al.
Published: (2025)

Subgradient Langevin Methods for Sampling from Non-smooth Potentials
by: Habring, Andreas, et al.
Published: (2023)

Sampling-Based Risk-Aware Path Planning Around Dynamic Engagement Zones
by: Wolek, Artur, et al.
Published: (2024)

Diffusion at Absolute Zero: Langevin Sampling using Successive Moreau Envelopes [journal paper]
by: Habring, Andreas, et al.
Published: (2025)

Accelerated zero-order SGD under high-order smoothness and overparameterized regime
by: Bychkov, Georgii, et al.
Published: (2024)

Adam symmetry theorem: characterization of the convergence of the stochastic Adam optimizer
by: Dereich, Steffen, et al.
Published: (2025)

Uniform a priori bounds and error analysis for the Adam stochastic gradient descent optimization method
by: Dereich, Steffen, et al.
Published: (2026)

ASMOP: Additional sampling stochastic trust region method for multi-objective problems
by: Jerinkić, Nataša Krklec, et al.
Published: (2025)

Fast Stochastic Second-Order Adagrad for Nonconvex Bound-Constrained Optimization
by: Bellavia, S., et al.
Published: (2025)

Physics-based Approximation and Prediction of Speedlines in Compressor Performance Maps
by: Akiev, Abdul-Malik, et al.
Published: (2026)

An objective-function-free algorithm for general smooth constrained optimization
by: Bellavia, S., et al.
Published: (2026)

A Simple First-Order Algorithm for Full-Rank Equality Constrained Optimization
by: Gratton, Serge, et al.
Published: (2025)

An objective-function-free algorithm for nonconvex stochastic optimization with deterministic equality and inequality constraints
by: Gratton, S., et al.
Published: (2026)

Escaping Saddle Points via Curvature-Calibrated Perturbations: A Complete Analysis with Explicit Constants and Empirical Validation
by: Alpay, Faruk, et al.
Published: (2025)

Resolving gradient pathology in physics-informed epidemiological models
by: Golooba, Nickson, et al.
Published: (2026)

Sufficient Conditions for Error Distance Reduction in the (\ell^2)-norm Trust Region between Minimizers of Local Nonconvex Multivariate Quadratic Approximates
by: Xie, Pengcheng
Published: (2023)

Zeroth-order gradient estimators for stochastic problems with decision-dependent distributions
by: Hikima, Yuya, et al.
Published: (2025)

On the Convergence Behavior of Preconditioned Gradient Descent Toward the Rich Learning Regime
by: Jiang, Shuai, et al.
Published: (2026)

Sparse Training of Neural Networks based on Multilevel Mirror Descent
by: Lunk, Yannick, et al.
Published: (2026)

Fast and Exact Least Absolute Deviations Line Fitting via Piecewise Affine Lower-Bounding
by: Volz, Stefan, et al.
Published: (2025)

Adam Improves Muon: Adaptive Moment Estimation with Orthogonalized Momentum
by: Zhang, Minxin, et al.
Published: (2026)

The Polar Express: Optimal Matrix Sign Methods and Their Application to the Muon Algorithm
by: Amsel, Noah, et al.
Published: (2025)

Gradient Descent Methods for Regularized Optimization
by: Nikolovski, Filip, et al.
Published: (2024)

Zeroth-Order Methods for Nonconvex Stochastic Problems with Decision-Dependent Distributions
by: Hikima, Yuya, et al.
Published: (2024)

Decentralized Stochastic Optimization over Unreliable Networks via Two-timescales Updates
by: Liu, Haoming, et al.
Published: (2025)