Imagen de Portada

Gradient Descent Is Optimal Under Lower Restricted Secant Inequality And Upper Error Bound

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Guille-Escuret, Charles, Ibrahim, Adam, Goujaud, Baptiste, Mitliagkas, Ioannis
Formato:	Preprint
Publicado:	2022
Materias:	Optimization and Control
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

A Study of Condition Numbers for First-Order Optimization
por: Guille-Escuret, Charles, et al.
Publicado: (2020)

Gradient Descent on Logistic Regression: Do Large Step-Sizes Work with Data on the Sphere?
por: Meng, Si Yi, et al.
Publicado: (2025)

On Linear Convergence of PI Consensus Algorithm under the Restricted Secant Inequality
por: Chakrabarti, Kushal, et al.
Publicado: (2023)

Provable non-accelerations of the heavy-ball method
por: Goujaud, Baptiste, et al.
Publicado: (2023)

Counter-examples in first-order optimization: a constructive approach
por: Goujaud, Baptiste, et al.
Publicado: (2023)

Open Problem: Two Riddles in Heavy-Ball Dynamics
por: Goujaud, Baptiste, et al.
Publicado: (2025)

Dictionary-Restricted First-Order Descent Methods: Bounds and Convergence Rates
por: Berasategui, Miguel, et al.
Publicado: (2026)

Complexity of Error Bounds for Systems of Linear Inequalities
por: Wei, Zhou, et al.
Publicado: (2025)

Solving Hidden Monotone Variational Inequalities with Surrogate Losses
por: D'Orazio, Ryan, et al.
Publicado: (2024)

Matching the Statistical Query Lower Bound for $k$-Sparse Parity Problems with Sign Stochastic Gradient Descent
por: Kou, Yiwen, et al.
Publicado: (2024)

Multilevel Stochastic Gradient Descent for Optimal Control Under Uncertainty
por: Baumgarten, Niklas, et al.
Publicado: (2025)

The Limit Points of (Optimistic) Gradient Descent in Min-Max Optimization
por: Daskalakis, Constantinos, et al.
Publicado: (2018)

Exploring Jacobian Inexactness in Second-Order Methods for Variational Inequalities: Lower Bounds, Optimal Algorithms and Quasi-Newton Approximations
por: Agafonov, Artem, et al.
Publicado: (2024)

Characterizations of Stability of Error Bounds for Convex Inequality Constraint Systems
por: Wei, Zhou, et al.
Publicado: (2021)

Convergence Rate Bounds for the Mirror Descent Method: IQCs, Popov Criterion and Bregman Divergence
por: Li, Mengmou, et al.
Publicado: (2023)

Lower and Upper Bounds for Small Canonical and Ordered Ramsey Numbers
por: Brosch, Daniel, et al.
Publicado: (2025)

On the Convergence of the Gradient Descent Method with Stochastic Fixed-point Rounding Errors under the Polyak-Lojasiewicz Inequality
por: Xia, Lu, et al.
Publicado: (2023)

A Strengthened Conjecture on the Minimax Optimal Constant Stepsize for Gradient Descent
por: Grimmer, Benjamin, et al.
Publicado: (2024)

Revisiting Stochastic Gradient Descent for Strongly Convex Objectives: Tight Uniform-in-Time Bounds
por: Chen, Kang, et al.
Publicado: (2025)

Secant Line Search for Frank-Wolfe Algorithms
por: Hendrych, Deborah, et al.
Publicado: (2025)

Natural Gradient Descent for Control
por: Esmzad, Ramin, et al.
Publicado: (2025)

The Popov's Algorithm with Optimal Bounded Stepsize for Generalized Monotone Variational Inequalities
por: Nguyen, Nhung Hong, et al.
Publicado: (2026)

High Probability Convergence Bounds for Non-convex Stochastic Gradient Descent with Sub-Weibull Noise
por: Madden, Liam, et al.
Publicado: (2020)

High-probability Convergence Bounds for Nonlinear Stochastic Gradient Descent Under Heavy-tailed Noise
por: Armacki, Aleksandar, et al.
Publicado: (2023)

Non-Stationary Gradient Descent for Optimal Auto-Scaling in Serverless Platforms
por: Anselmi, Jonatha, et al.
Publicado: (2025)

Converse Lyapunov Results for Switched Systems with Lower and Upper Bounds on Switching Intervals
por: Della Rossa, Matteo
Publicado: (2024)

Interpretable Gradient Descent for Kalman Gain
por: Belabbas, M. A., et al.
Publicado: (2025)

Peak Bounds for the Estimation Error under Sensor Attacks
por: Stafström, Axel, et al.
Publicado: (2026)

Mirror and Preconditioned Gradient Descent in Wasserstein Space
por: Bonet, Clément, et al.
Publicado: (2024)

Nonasymptotic Analysis of Accelerated Methods With Inexact Oracle Under Absolute Error Bound
por: Liu, Yin, et al.
Publicado: (2024)

Stochastic Adaptive Gradient Descent Without Descent
por: Aujol, Jean-François, et al.
Publicado: (2025)

Advancing Multi-Secant Quasi-Newton Methods for General Convex Functions
por: Lee, Mokhwa, et al.
Publicado: (2025)

Understanding the Influence of Digraphs on Decentralized Optimization: Effective Metrics, Lower Bound, and Optimal Algorithm
por: Liang, Liyuan, et al.
Publicado: (2023)

Tight Lower Bounds and Optimal Algorithms for Stochastic Nonconvex Optimization with Heavy-Tailed Noise
por: Fradin, Adrien, et al.
Publicado: (2025)

Communication-Efficient Gradient Descent-Accent Methods for Distributed Variational Inequalities: Unified Analysis and Local Updates
por: Zhang, Siqi, et al.
Publicado: (2023)

Accelerated Gradient Descent by Concatenation of Stepsize Schedules
por: Zhang, Zehao, et al.
Publicado: (2024)

Gradient Descent for Convex and Smooth Noisy Optimization
por: Hu, Feifei, et al.
Publicado: (2024)

Last-Iterate Convergence of Anchored Gradient Descent
por: Cai, Yang, et al.
Publicado: (2026)

Riemannian Inexact Gradient Descent for Quadratic Discrimination
por: Talwar, Uday, et al.
Publicado: (2025)

Composing Optimized Stepsize Schedules for Gradient Descent
por: Grimmer, Benjamin, et al.
Publicado: (2024)