Imagen de Portada

A unified convergence theory for adaptive first-order methods in the nonconvex case, including AdaNorm, full and diagonal AdaGrad, Shampoo and Muo

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Gratton, S., Toint, Ph. L.
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning 90C26, 90C06, 90C15, 90C30 I.2.6; F.2.1; G.1.6
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Stochastic convergence of parallel asynchronous adaptive first-order methods
por: Gratton, Serge, et al.
Publicado: (2026)

Complexity and performance for two classes of noise-tolerant first-order algorithms
por: Gratton, S., et al.
Publicado: (2022)

Complexity of Adagrad and other first-order methods for nonconvex optimization problems with bounds constraints
por: Gratton, Serge, et al.
Publicado: (2024)

OPM, a collection of Optimization Problems in Matlab
por: Gratton, Serge, et al.
Publicado: (2021)

Stability and convergence analysis of AdaGrad for non-convex optimization via novel stopping time-based techniques
por: Jin, Ruinan, et al.
Publicado: (2024)

Recursive Bound-Constrained AdaGrad with Applications to Multilevel and Domain Decomposition Minimization
por: Gratton, Serge, et al.
Publicado: (2025)

Convex Mixed-Integer Nonlinear Programs Derived from Generalized Disjunctive Programming using Cones
por: Neira, David E. Bernal, et al.
Publicado: (2021)

Pseudoconvex Problems in Operational Decision Systems: Algorithms for Joint Learning and Optimization
por: Li, Zijun, et al.
Publicado: (2026)

Multi-Objective Optimization with Desirability and Morris-Mitchell Criterion
por: Bartz-Beielstein, Thomas, et al.
Publicado: (2025)

Adaptive Conditional Forest Sampling for Spectral Risk Optimisation under Decision-Dependent Uncertainty
por: Kurbucz, Marcell T.
Publicado: (2026)

Depth-first directional search for nonconvex optimization
por: Zhang, Yuxuan, et al.
Publicado: (2024)

Taming Nonconvex Stochastic Mirror Descent with General Bregman Divergence
por: Fatkhullin, Ilyas, et al.
Publicado: (2024)

Enhancing Model Based Derivative Free Optimization using Direct Search
por: Li, Zijun, et al.
Publicado: (2026)

Comparative Evaluation of SDP, SOCP, and QC Convex Relaxations for Large-Scale Market-Based AC Optimal Power Flow
por: Keskin, Ata
Publicado: (2026)

IGT-OMD: Implicit Gradient Transport for Decision-Focused Learning under Delayed Feedback
por: Amoh, Benjamin, et al.
Publicado: (2026)

Barrier Algorithms for Constrained Non-Convex Optimization
por: Dvurechensky, Pavel, et al.
Publicado: (2024)

CAO: Curvature-Adaptive Optimization via Periodic Low-Rank Hessian Sketching
por: Du, Wenzhang
Publicado: (2025)

Decentralized projected Riemannian stochastic recursive momentum method for nonconvex optimization
por: Deng, Kangkang, et al.
Publicado: (2024)

Natural Gradient VI: Guarantees for Non-Conjugate Models
por: Sun, Fangyuan, et al.
Publicado: (2025)

Escaping Saddle Points via Curvature-Calibrated Perturbations: A Complete Analysis with Explicit Constants and Empirical Validation
por: Alpay, Faruk, et al.
Publicado: (2025)

A Structured Tour of Optimization with Finite Differences
por: Rando, Marco, et al.
Publicado: (2025)

Bed-Attached Vibration Sensor System: A Machine Learning Approach for Fall Detection in Nursing Homes
por: Bartz-Beielstein, Thomas, et al.
Publicado: (2024)

Simplifying Hyperparameter Tuning in Online Machine Learning -- The spotRiverGUI
por: Bartz-Beielstein, Thomas
Publicado: (2024)

Refining Graphical Neural Network Predictions Using Flow Matching for Optimal Power Flow with Constraint-Satisfaction Guarantee
por: Khanal, Kshitiz
Publicado: (2025)

Optimizing Donor Outreach for Blood Collection Sessions: A Scalable Decision Support Framework
por: Carneiro, André, et al.
Publicado: (2026)

Norm-induced Cuts: Outer Approximation for Lipschitzian Constraint Functions
por: Göß, Adrian, et al.
Publicado: (2024)

Convergence rate of the (1+1)-evolution strategy on locally strongly convex functions with lipschitz continuous gradient
por: Morinaga, Daiki, et al.
Publicado: (2022)

From Non-Identifiability to Goal-Integrated Decision-Making in Parametric Inverse Optimization
por: Ahmadi, Farzin, et al.
Publicado: (2026)

Robust Markov stability for community detection at a scale learned based on the structure
por: Aref, Samin, et al.
Publicado: (2025)

A four-operator splitting algorithm for nonconvex and nonsmooth optimization
por: Alcantara, Jan Harold, et al.
Publicado: (2024)

pFedSOP : Accelerating Training Of Personalized Federated Learning Using Second-Order Optimization
por: Sen, Mrinmay, et al.
Publicado: (2025)

A first-order method for nonconvex-strongly-concave constrained minimax optimization
por: Lu, Zhaosong, et al.
Publicado: (2025)

AI-Enhanced IoT Systems for Predictive Maintenance and Affordability Optimization in Smart Microgrids: A Digital Twin Approach
por: Kushal, Koushik Ahmed, et al.
Publicado: (2025)

Troika algorithm: approximate optimization for accurate clique partitioning and clustering of weighted networks
por: Aref, Samin, et al.
Publicado: (2025)

On convergence of a $q$-random coordinate constrained algorithm for non-convex problems
por: Ghaffari-Hadigheh, Alireza, et al.
Publicado: (2022)

Anisotropic Gaussian Smoothing for Gradient-based Optimization
por: Starnes, Andrew, et al.
Publicado: (2024)

Adaptive Methods for Multiobjective Unit Commitment
por: Tevruez, Ece, et al.
Publicado: (2025)

Last-iterate Convergence of ADMM on Multi-affine Quadratic Equality Constrained Problem
por: Chao, Yutong, et al.
Publicado: (2026)

Variance-reduced first-order methods for deterministically constrained stochastic nonconvex optimization with strong convergence guarantees
por: Lu, Zhaosong, et al.
Publicado: (2024)

FlowAdam: Implicit Regularization via Geometry-Aware Soft Momentum Injection
por: Singh, Devender, et al.
Publicado: (2026)