Imagen de Portada

Accelerated Objective Gap and Gradient Norm Convergence for Gradient Descent via Long Steps

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Grimmer, Benjamin, Shu, Kevin, Wang, Alex L.
Formato:	Preprint
Publicado:	2024
Materias:	Optimization and Control
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Composing Optimized Stepsize Schedules for Gradient Descent
por: Grimmer, Benjamin, et al.
Publicado: (2024)

Provably Faster Gradient Descent via Long Steps
por: Grimmer, Benjamin
Publicado: (2023)

A Strengthened Conjecture on the Minimax Optimal Constant Stepsize for Gradient Descent
por: Grimmer, Benjamin, et al.
Publicado: (2024)

Beyond Minimax Optimality: A Subgame Perfect Gradient Method
por: Grimmer, Benjamin, et al.
Publicado: (2024)

On Averaging and Extrapolation for Gradient Descent
por: Luner, Alan, et al.
Publicado: (2024)

A Practical Adaptive Subgame Perfect Gradient Method
por: Luner, Alan, et al.
Publicado: (2025)

Inexactly Smooth Performance Estimation and New Optimized Gradient Methods
por: Zoll, Aaron, et al.
Publicado: (2026)

Faster Convergence of Stochastic Accelerated Gradient Descent under Interpolation
por: Mishkin, Aaron, et al.
Publicado: (2024)

Last-Iterate Convergence of Anchored Gradient Descent
por: Cai, Yang, et al.
Publicado: (2026)

Anytime Acceleration of Gradient Descent
por: Zhang, Zihan, et al.
Publicado: (2024)

On Convergence of the Iteratively Preconditioned Gradient-Descent (IPG) Observer
por: Chakrabarti, Kushal, et al.
Publicado: (2024)

Subgame Perfect Methods in Nonsmooth Convex Optimization
por: Grimmer, Benjamin, et al.
Publicado: (2025)

Accelerated Gradient Descent by Concatenation of Stepsize Schedules
por: Zhang, Zehao, et al.
Publicado: (2024)

A Proof of the Exact Convergence Rate of Gradient Descent
por: Kim, Jungbin
Publicado: (2024)

Adaptive Accelerated Gradient Descent Methods for Convex Optimization
por: Xu, Zeyi, et al.
Publicado: (2026)

Learning Provably Improves the Convergence of Gradient Descent
por: Song, Qingyu, et al.
Publicado: (2025)

Convergence of Alternating Gradient Descent for Matrix Factorization
por: Ward, Rachel, et al.
Publicado: (2023)

Revisiting Stochastic Gradient Descent for Strongly Convex Objectives: Tight Uniform-in-Time Bounds
por: Chen, Kang, et al.
Publicado: (2025)

Towards Noise-adaptive, Problem-adaptive (Accelerated) Stochastic Gradient Descent
por: Vaswani, Sharan, et al.
Publicado: (2021)

Accelerating Proximal Gradient Descent via Silver Stepsizes
por: Bok, Jinho, et al.
Publicado: (2024)

Convergence and Trade-Offs in Riemannian Gradient Descent and Riemannian Proximal Point
por: Martínez-Rubio, David, et al.
Publicado: (2024)

Adaptive Step Sizes for Preconditioned Stochastic Gradient Descent
por: Köhne, Frederik, et al.
Publicado: (2023)

Open Problem: Anytime Convergence Rate of Gradient Descent
por: Kornowski, Guy, et al.
Publicado: (2024)

Convergence Analysis of Stochastic Gradient Descent with MCMC Estimators
por: Li, Tianyou, et al.
Publicado: (2023)

On the Convergence of Gradient Descent on Learning Transformers with Residual Connections
por: Qin, Zhen, et al.
Publicado: (2025)

High Probability Convergence of Distributed Clipped Stochastic Gradient Descent with Heavy-tailed Noise
por: Yang, Yuchen, et al.
Publicado: (2025)

Convergence Rate Analysis for Monotone Accelerated Proximal Gradient Method
por: Wang, Zepeng, et al.
Publicado: (2025)

Analysis of Gradient Descent with Varying Step Sizes using Integral Quadratic Constraints
por: Padmanabhan, Ram, et al.
Publicado: (2022)

The Anytime Convergence of Stochastic Gradient Descent with Momentum: From a Continuous-Time Perspective
por: Feng, Yasong, et al.
Publicado: (2023)

On the Convergence of Projected Policy Gradient for Any Constant Step Sizes
por: Liu, Jiacai, et al.
Publicado: (2023)

Natural Gradient Descent for Control
por: Esmzad, Ramin, et al.
Publicado: (2025)

Gradient Descent Converges Linearly to Flatter Minima than Gradient Flow in Shallow Linear Networks
por: Beneventano, Pierfrancesco, et al.
Publicado: (2025)

Convergence of Gradient Descent with Small Initialization for Unregularized Matrix Completion
por: Ma, Jianhao, et al.
Publicado: (2024)

Convergence Properties of Natural Gradient Descent for Minimizing KL Divergence
por: Datar, Adwait, et al.
Publicado: (2025)

Exponential Convergence of (Stochastic) Gradient Descent for Separable Logistic Regression
por: Kale, Sacchit, et al.
Publicado: (2026)

Convergence and Implicit Bias of Gradient Descent on Continual Linear Classification
por: Jung, Hyunji, et al.
Publicado: (2025)

On the Convergence of Stochastic Gradient Descent with Perturbed Forward-Backward Passes
por: Kong, Boao, et al.
Publicado: (2026)

Convergence of First-Order Algorithms with Momentum from the Perspective of an Inexact Gradient Descent Method
por: Khanh, Pham Duy, et al.
Publicado: (2025)

A Nesterov-style Accelerated Gradient Descent Algorithm for the Symmetric Eigenvalue Problem
por: Alimisis, Foivos, et al.
Publicado: (2024)

Interpretable Gradient Descent for Kalman Gain
por: Belabbas, M. A., et al.
Publicado: (2025)