Image de couverture de livre

Local Curvature Descent: Squeezing More Curvature out of Standard and Polyak Gradient Descent

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Richtárik, Peter, Giancola, Simone Maria, Lubczyk, Dymitr, Yadav, Robin
Format:	Preprint
Publié:	2024
Sujets:	Optimization and Control
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Adaptive Gradient Descent on Riemannian Manifolds with Nonnegative Curvature
par: Ansari-Önnestam, Aban, et autres
Publié: (2025)

A Local Polyak-Lojasiewicz and Descent Lemma of Gradient Descent For Overparametrized Linear Models
par: Xu, Ziqing, et autres
Publié: (2025)

Parameter-free Clipped Gradient Descent Meets Polyak
par: Takezawa, Yuki, et autres
Publié: (2024)

Det-CGD: Compressed Gradient Descent with Matrix Stepsizes for Non-Convex Optimization
par: Li, Hanmin, et autres
Publié: (2023)

Gradient Descent with Polyak's Momentum Finds Flatter Minima via Large Catapults
par: Phunyaphibarn, Prin, et autres
Publié: (2023)

Differentially Private Random Block Coordinate Descent
par: Maranjyan, Artavazd, et autres
Publié: (2024)

Curvature-Adaptive Perturbation and Subspace Descent for Robust Saddle Point Escape in High-Dimensional Optimization
par: Katende, Ronald, et autres
Publié: (2024)

Natural Gradient Descent for Control
par: Esmzad, Ramin, et autres
Publié: (2025)

Stochastic Adaptive Gradient Descent Without Descent
par: Aujol, Jean-François, et autres
Publié: (2025)

On the Convergence of the Gradient Descent Method with Stochastic Fixed-point Rounding Errors under the Polyak-Lojasiewicz Inequality
par: Xia, Lu, et autres
Publié: (2023)

Interpretable Gradient Descent for Kalman Gain
par: Belabbas, M. A., et autres
Publié: (2025)

Corner Gradient Descent
par: Yarotsky, Dmitry
Publié: (2025)

Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models
par: Kunstner, Frederik, et autres
Publié: (2024)

Anytime Acceleration of Gradient Descent
par: Zhang, Zihan, et autres
Publié: (2024)

Accelerated Gradient Descent by Concatenation of Stepsize Schedules
par: Zhang, Zehao, et autres
Publié: (2024)

Gradient Descent for Convex and Smooth Noisy Optimization
par: Hu, Feifei, et autres
Publié: (2024)

Composing Optimized Stepsize Schedules for Gradient Descent
par: Grimmer, Benjamin, et autres
Publié: (2024)

Last-Iterate Convergence of Anchored Gradient Descent
par: Cai, Yang, et autres
Publié: (2026)

Riemannian Inexact Gradient Descent for Quadratic Discrimination
par: Talwar, Uday, et autres
Publié: (2025)

Adaptive Conditional Gradient Descent
par: Khademi, Abbas, et autres
Publié: (2025)

$k$-SVD with Gradient Descent
par: Jedra, Yassir, et autres
Publié: (2025)

Locally Regularized Sparse Graph by Fast Proximal Gradient Descent
par: Sun, Dongfang, et autres
Publié: (2024)

Analysis of Gradient Descent with Varying Step Sizes using Integral Quadratic Constraints
par: Padmanabhan, Ram, et autres
Publié: (2022)

Resilient Two-Time-Scale Local Stochastic Gradient Descent for Byzantine Federated Learning
par: Dutta, Amit, et autres
Publié: (2024)

On Convergence of the Iteratively Preconditioned Gradient-Descent (IPG) Observer
par: Chakrabarti, Kushal, et autres
Publié: (2024)

Tropical Gradient Descent
par: Talbut, Roan, et autres
Publié: (2024)

Local LMO: Constrained Gradient Optimization via a Local Linear Minimization Oracle
par: Richtárik, Peter, et autres
Publié: (2026)

A Proof of the Exact Convergence Rate of Gradient Descent
par: Kim, Jungbin
Publié: (2024)

Projected Gradient Descent for Constrained Decision-Dependent Optimization
par: Wang, Zifan, et autres
Publié: (2025)

Adaptive Accelerated Gradient Descent Methods for Convex Optimization
par: Xu, Zeyi, et autres
Publié: (2026)

Decentralized Relaxed Smooth Optimization with Gradient Descent Methods
par: Jiang, Zhanhong, et autres
Publié: (2025)

More Optimal Fractional-Order Stochastic Gradient Descent for Non-Convex Optimization Problems
par: Partohaghighi, Mohammad, et autres
Publié: (2025)

Stochastic Gradient Descent with Adaptive Data
par: Che, Ethan, et autres
Publié: (2024)

Unraveling the Gradient Descent Dynamics of Transformers
par: Song, Bingqing, et autres
Publié: (2024)

Stochastic Gradient Descent with Strategic Querying
par: Jiang, Nanfei, et autres
Publié: (2025)

IRKA is a Riemannian Gradient Descent Method
par: Mlinarić, Petar, et autres
Publié: (2023)

Trajectory-Oriented Control Using Gradient Descent: An Unconventional Approach
par: Esmzad, Ramin, et autres
Publié: (2024)

Descent-Net: Learning Descent Directions for Constrained Optimization
par: Zhou, Zisheng, et autres
Publié: (2025)

Model Predictive Path Integral Control as Preconditioned Gradient Descent
par: Fazlyab, Mahyar, et autres
Publié: (2026)

On a Family of Relaxed Gradient Descent Methods for Quadratic Minimization
par: MacDonald, Liam, et autres
Publié: (2024)