Copertina

Asymptotic Convergence and Stability of Adaptive Gradient Methods in Smooth Non-convex Optimization

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Jin, Ruinan, Wang, Xiaoyu
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Optimization and Control 90C06, 90C15, 90C26, 90C30, 65K05, 49M37
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Stability and convergence analysis of AdaGrad for non-convex optimization via novel stopping time-based techniques
di: Jin, Ruinan, et al.
Pubblicazione: (2024)

On the Convergence and Complexity of Proximal Gradient and Accelerated Proximal Gradient Methods under Adaptive Gradient Estimation
di: Bollapragada, Raghu, et al.
Pubblicazione: (2025)

First- and Second-Order Stochastic Adaptive Regularization with Cubics: High Probability Iteration and Sample Complexity
di: Scheinberg, Katya, et al.
Pubblicazione: (2023)

A Proximal Stochastic Gradient Method with Adaptive Step Size and Variance Reduction for Convex Composite Optimization
di: Fang, Changjie, et al.
Pubblicazione: (2025)

Alternating Gradient-Type Algorithm for Bilevel Optimization with Inexact Lower-Level Solutions via Moreau Envelope-based Reformulation
di: Bai, Xiaoning, et al.
Pubblicazione: (2024)

Retrospective Approximation Sequential Quadratic Programming for Stochastic Optimization with General Deterministic Nonlinear Constraints
di: Berahas, Albert S., et al.
Pubblicazione: (2025)

A Two Stepsize SQP Method for Nonlinear Equality Constrained Stochastic Optimization
di: O'Neill, Michael J.
Pubblicazione: (2024)

Fast Frank--Wolfe Algorithms with Adaptive Bregman Step-Size for Weakly Convex Functions
di: Takahashi, Shota, et al.
Pubblicazione: (2025)

On the Convergence of Interior-Point Methods for Bound-Constrained Nonlinear Optimization Problems with Noise
di: Dezfulian, Shima, et al.
Pubblicazione: (2024)

Inexact Riemannian Gradient Descent Method for Nonconvex Optimization
di: Zhou, Juan, et al.
Pubblicazione: (2024)

Non-Convex Self-Concordant Functions: Practical Algorithms and Complexity Analysis
di: Goldfarb, Donald, et al.
Pubblicazione: (2025)

Randomized block proximal method with locally Lipschitz continuous gradient
di: Pérez-Aros, Pedro, et al.
Pubblicazione: (2025)

Level Constrained First Order Methods for Function Constrained Optimization
di: Boob, Digvijay, et al.
Pubblicazione: (2022)

A General Recipe for Parameter-Free Nonconvex Optimization via Higher-Order Regularization
di: Marumo, Naoki, et al.
Pubblicazione: (2026)

Oracle complexities of augmented Lagrangian methods for nonsmooth manifold optimization
di: Deng, Kangkang, et al.
Pubblicazione: (2024)

Complexity of an inexact stochastic SQP algorithm for equality constrained optimization
di: O'Neill, Michael J., et al.
Pubblicazione: (2026)

Augmented Lagrangian methods for fully convex composite optimization
di: De Marchi, Alberto, et al.
Pubblicazione: (2025)

Heavy-ball Differential Equation Achieves $O(\varepsilon^{-7/4})$ Convergence for Nonconvex Functions
di: Okamura, Kaito, et al.
Pubblicazione: (2024)

A globalization of L-BFGS and the Barzilai-Borwein method for nonconvex unconstrained optimization
di: Mannel, Florian
Pubblicazione: (2024)

Linesearch-free adaptive Bregman proximal gradient for convex minimization without relative smoothness
di: Ou, Hongjia, et al.
Pubblicazione: (2025)

Trust-Region Method for Optimization of Set-Valued Maps Given by Finitely Many Functions
di: Ghosh, Suprova, et al.
Pubblicazione: (2025)

Parallel block coordinate descent methods with identification strategies
di: Lopes, Ronaldo, et al.
Pubblicazione: (2025)

One-parameter Filled Function Method for Non-convex Multi-objective Optimization Problems
di: Adhikary, Bikram, et al.
Pubblicazione: (2026)

Model-Driven Subspaces for Large-Scale Optimization with Local Approximation Strategy
di: He, Yitong, et al.
Pubblicazione: (2025)

A structured L-BFGS method and its application to inverse problems
di: Mannel, Florian, et al.
Pubblicazione: (2023)

A structured L-BFGS method with diagonal scaling and its application to image registration
di: Mannel, Florian, et al.
Pubblicazione: (2024)

MGProx: A nonsmooth multigrid proximal gradient method with adaptive restriction for strongly convex optimization
di: Ang, Andersen, et al.
Pubblicazione: (2023)

MoSSP: A Momentum-Based Single-Loop Stochastic Penalty Method for Nonconvex Constrained DC-Regularized Optimization
di: Li, Luxuan, et al.
Pubblicazione: (2026)

An Inexact Regularized Proximal Newton Method without Line Search
di: Dahl, Simeon vom, et al.
Pubblicazione: (2024)

Accelerated Gradient Methods with Gradient Restart: Global Linear Convergence
di: Bao, Chenglong, et al.
Pubblicazione: (2024)

On the convergence of proximal gradient methods for convex simple bilevel optimization
di: Latafat, Puya, et al.
Pubblicazione: (2023)

Convergence analysis of the transformed gradient projection algorithms on compact matrix manifolds
di: Ding, Wentao, et al.
Pubblicazione: (2024)

Local Convergence Analysis of ADMM for Nonconvex Composite Optimization
di: Xie, Xiyuan, et al.
Pubblicazione: (2026)

Convergence Conditions for Stochastic Line Search Based Optimization of Over-parametrized Models
di: Lapucci, Matteo, et al.
Pubblicazione: (2024)

ItsDEAL: Inexact two-level smoothing descent algorithms for weakly convex optimization
di: Kabgani, Alireza, et al.
Pubblicazione: (2025)

Mathematical programs with complementarity constraints and application to hyperparameter tuning for nonlinear support vector machines
di: Ward, Samuel, et al.
Pubblicazione: (2025)

Inexact Limited Memory Bundle Method
di: Lampainen, Jenni, et al.
Pubblicazione: (2026)

Flexible block-iterative analysis for the Frank-Wolfe algorithm
di: Braun, Gábor, et al.
Pubblicazione: (2024)

A Cubic Regularization Method for Multiobjective Optimization
di: Gonçalves, Douglas S., et al.
Pubblicazione: (2025)

AS-BOX: Additional Sampling Method for Weighted Sum Problems with Box Constraints
di: Krejić, Nataša, et al.
Pubblicazione: (2025)