The Essential Best and Average Rate of Convergence of the Exact Line Search Gradient Descent Method

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Yu, Thomas
Format:	Preprint
Published:	2023
Subjects:	Numerical Analysis Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

IRKA is a Riemannian Gradient Descent Method
by: Mlinarić, Petar, et al.
Published: (2023)

Tight Convergence Rates in Gradient Mapping for the Difference-of-Convex Algorithm
by: Rotaru, Teodor, et al.
Published: (2025)

On the Convergence of the Gradient Descent Method with Stochastic Fixed-point Rounding Errors under the Polyak-Lojasiewicz Inequality
by: Xia, Lu, et al.
Published: (2023)

Fast Unconstrained Optimization via Hessian Averaging and Adaptive Gradient Sampling Methods
by: O'Leary-Roseberry, Thomas, et al.
Published: (2024)

Low-Discrepancy Set Post-Processing via Gradient Descent
by: Clément, François, et al.
Published: (2025)

Convergence Analysis of Fractional Gradient Descent
by: Aggarwal, Ashwani
Published: (2023)

Inexact Projected Preconditioned Gradient Methods with Variable Metrics: General Convergence Theory via Lyapunov Approach
by: Guo, Ruchi, et al.
Published: (2025)

Block Acceleration Without Momentum: On Optimal Stepsizes of Block Gradient Descent for Least-Squares
by: Peng, Liangzu, et al.
Published: (2024)

The Stochastic Steepest Descent Method for Robust Optimization in Banach Spaces
by: Chada, Neil K., et al.
Published: (2023)

An Inexact General Descent Method with Applications in Differential Equation-Constrained Optimization
by: Macedo, Humberto Gimenes, et al.
Published: (2025)

Super Gradient Descent: Global Optimization requires Global Gradient
by: Achour, Seifeddine
Published: (2024)

A Derivative-Free Saddle-search Algorithm With Linear Convergence Rate
by: Du, Qiang, et al.
Published: (2026)

Global Convergence and Error Propagation in Neural Gradient Flows: A Riemannian Optimization Framework
by: Zheng, Shixin, et al.
Published: (2026)

Provably Faster Gradient Descent via Long Steps
by: Grimmer, Benjamin
Published: (2023)

Wasserstein Gradient Flows of the Discrepancy with Distance Kernel on the Line
by: Hertrich, Johannes, et al.
Published: (2023)

Multilevel Stochastic Gradient Descent for Optimal Control Under Uncertainty
by: Baumgarten, Niklas, et al.
Published: (2025)

Global Convergence of High-Order Regularization Methods with Sums-of-Squares Taylor Models
by: Zhu, Wenqi, et al.
Published: (2024)

On Global Rates for Regularization Methods based on Secant Derivative Approximations
by: Cartis, Coralia, et al.
Published: (2025)

Gradient Descent as a Perceptron Algorithm: Understanding Dynamics and Implicit Acceleration
by: Tyurin, Alexander
Published: (2025)

Fast and Numerically Stable Implementation of Rate Constant Matrix Contraction Method
by: Hemmi, Shinichi, et al.
Published: (2024)

Projected Block Coordinate Descent for sparse spike estimation
by: Bénard, Pierre-Jean, et al.
Published: (2024)

Gradient is All You Need? How Consensus-Based Optimization can be Interpreted as a Stochastic Relaxation of Gradient Descent
by: Riedl, Konstantin, et al.
Published: (2023)

Dual Cone Gradient Descent for Training Physics-Informed Neural Networks
by: Hwang, Youngsik, et al.
Published: (2024)

Convergence Analysis of the Upwind Difference Methods for Hamilton-Jacobi-Bellman Equations
by: Inoue, Daisuke, et al.
Published: (2023)

Accelerated Primal-Dual Proximal Gradient Splitting Methods for Convex-Concave Saddle-Point Problems
by: Luo, Hao
Published: (2024)

Modified Loss of Momentum Gradient Descent: Fine-Grained Analysis
by: Cattaneo, Matias D., et al.
Published: (2025)

Fast and Provable Tensor-Train Format Tensor Completion via Precondtioned Riemannian Gradient Descent
by: Bian, Fengmiao, et al.
Published: (2025)

A Primal-dual Forward-backward Splitting Method for Cross-diffusion Gradient Flows with General Mobility Matrices
by: Deng, Yunhong, et al.
Published: (2025)

Convergent Complex Quasi-Newton Proximal Methods for Gradient-Driven Denoisers in Compressed Sensing MRI Reconstruction
by: Hong, Tao, et al.
Published: (2025)

A Block Coordinate Descent Method for Nonsmooth Composite Optimization under Orthogonality Constraints
by: Yuan, Ganzhao
Published: (2023)

Wasserstein Steepest Descent Flows of Discrepancies with Riesz Kernels
by: Hertrich, Johannes, et al.
Published: (2022)

Strong convergence, perturbation resilience and superiorization of Generalized Modular String-Averaging with infinitely many input operators
by: Barshad, Kay, et al.
Published: (2026)

Convergent Proximal Multiblock ADMM for Nonconvex Dynamics-Constrained Optimization
by: Li, Bowen, et al.
Published: (2025)

An Abstract Lyapunov Control Optimizer: Local Stabilization and Global Convergence
by: Bensaid, Bilel, et al.
Published: (2024)

Gradient-adjusted underdamped Langevin dynamics for sampling
by: Zuo, Xinzhe, et al.
Published: (2024)

Adaptive Proximal Gradient Method for Convex Optimization
by: Malitsky, Yura, et al.
Published: (2023)

Convergence of differentiable non-monotone schemes for fully nonlinear parabolic equations
by: Nakano, Yumiharu
Published: (2018)

Convergence analysis of Lie and Strang splitting for operator-valued differential Riccati equations
by: Hansen, Eskil, et al.
Published: (2025)

Convergence analysis of multi-step one-shot methods for linear inverse problems
by: Bonazzoli, Marcella, et al.
Published: (2022)

Convergence of a particle method for gradient flows on the $L^p$-Wasserstein space
by: Lei, Rong
Published: (2025)