Image de couverture de livre

Faster Convergence of Stochastic Accelerated Gradient Descent under Interpolation

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Mishkin, Aaron, Pilanci, Mert, Schmidt, Mark
Format:	Preprint
Publié:	2024
Sujets:	Optimization and Control Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Faster Convergence of Riemannian Stochastic Gradient Descent with Increasing Batch Size
par: Oowada, Kanata, et autres
Publié: (2025)

Enhancing Stochastic Gradient Descent: A Unified Framework and Novel Acceleration Methods for Faster Convergence
par: Deng, Yichuan, et autres
Publié: (2024)

Directional Smoothness and Gradient Methods: Convergence and Adaptivity
par: Mishkin, Aaron, et autres
Publié: (2024)

Active Learning of Deep Neural Networks via Gradient-Free Cutting Planes
par: Zhang, Erica, et autres
Publié: (2024)

CRONOS: Enhancing Deep Learning with Scalable GPU Accelerated Convex Neural Networks
par: Feng, Miria, et autres
Publié: (2024)

Convergence Analysis of Stochastic Gradient Descent with MCMC Estimators
par: Li, Tianyou, et autres
Publié: (2023)

Faster Acceleration for Steepest Descent
par: Bai, Cedar Site, et autres
Publié: (2024)

Glocal Smoothness: Line search and adaptive step sizes can help in theory too!
par: Fox, Curtis, et autres
Publié: (2025)

Analyzing Neural Network-Based Generative Diffusion Models through Convex Optimization
par: Zhang, Fangzhao, et autres
Publié: (2024)

Convex Relaxations of ReLU Neural Networks Approximate Global Optima in Polynomial Time
par: Kim, Sungyoon, et autres
Publié: (2024)

Armijo Line-search Can Make (Stochastic) Gradient Descent Provably Faster
par: Vaswani, Sharan, et autres
Publié: (2025)

Exponential Convergence of (Stochastic) Gradient Descent for Separable Logistic Regression
par: Kale, Sacchit, et autres
Publié: (2026)

On the Convergence of Stochastic Gradient Descent with Perturbed Forward-Backward Passes
par: Kong, Boao, et autres
Publié: (2026)

Algorithmic Stability of Stochastic Gradient Descent with Momentum under Heavy-Tailed Noise
par: Dang, Thanh, et autres
Publié: (2025)

A Library of Mirrors: Deep Neural Nets in Low Dimensions are Convex Lasso Models with Reflection Features
par: Zeger, Emi, et autres
Publié: (2024)

Coupling-based Convergence Diagnostic and Stepsize Scheme for Stochastic Gradient Descent
par: Li, Xiang, et autres
Publié: (2024)

A Recovery Guarantee for Sparse Neural Networks
par: Fridovich-Keil, Sara, et autres
Publié: (2025)

Accelerated Convergence of Stochastic Heavy Ball Method under Anisotropic Gradient Noise
par: Pan, Rui, et autres
Publié: (2023)

Towards Noise-adaptive, Problem-adaptive (Accelerated) Stochastic Gradient Descent
par: Vaswani, Sharan, et autres
Publié: (2021)

Stochastic Adaptive Gradient Descent Without Descent
par: Aujol, Jean-François, et autres
Publié: (2025)

On the Convergence of (Stochastic) Gradient Descent for Kolmogorov--Arnold Networks
par: Gao, Yihang, et autres
Publié: (2024)

From Complexity to Clarity: Analytical Expressions of Deep Neural Network Weights via Clifford's Geometric Algebra and Convexity
par: Pilanci, Mert
Publié: (2023)

Adversarial Training of Two-Layer Polynomial and ReLU Activation Networks via Convex Optimization
par: Kuelbs, Daniel, et autres
Publié: (2024)

Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models
par: Zhang, Fangzhao, et autres
Publié: (2024)

Controlling the Flow: Stability and Convergence for Stochastic Gradient Descent with Decaying Regularization
par: Kassing, Sebastian, et autres
Publié: (2025)

Increasing Both Batch Size and Learning Rate Accelerates Stochastic Gradient Descent
par: Umeda, Hikaru, et autres
Publié: (2024)

Anytime Acceleration of Gradient Descent
par: Zhang, Zihan, et autres
Publié: (2024)

Stochastic Gradient Descent with Adaptive Data
par: Che, Ethan, et autres
Publié: (2024)

Stochastic Gradient Descent with Strategic Querying
par: Jiang, Nanfei, et autres
Publié: (2025)

Learning Provably Improves the Convergence of Gradient Descent
par: Song, Qingyu, et autres
Publié: (2025)

Convergence of Alternating Gradient Descent for Matrix Factorization
par: Ward, Rachel, et autres
Publié: (2023)

On the Convergence of the Gradient Descent Method with Stochastic Fixed-point Rounding Errors under the Polyak-Lojasiewicz Inequality
par: Xia, Lu, et autres
Publié: (2023)

Quantitative Convergence Analysis of Projected Stochastic Gradient Descent for Non-Convex Losses via the Goldstein Subdifferential
par: Zheng, Yuping, et autres
Publié: (2025)

RESIST: Resilient Decentralized Learning Using Consensus Gradient Descent
par: Fang, Cheng, et autres
Publié: (2025)

Momentum Does Not Reduce Stochastic Noise in Stochastic Gradient Descent
par: Sato, Naoki, et autres
Publié: (2024)

Derivatives of Stochastic Gradient Descent in parametric optimization
par: Iutzeler, Franck, et autres
Publié: (2024)

Open Problem: Anytime Convergence Rate of Gradient Descent
par: Kornowski, Guy, et autres
Publié: (2024)

On the Convergence of Gradient Descent on Learning Transformers with Residual Connections
par: Qin, Zhen, et autres
Publié: (2025)

Implicit Bias and Convergence of Matrix Stochastic Mirror Descent
par: Akhtiamov, Danil, et autres
Publié: (2026)

In-Expectation Convergence of Stochastic Gradient Methods under Heavy-Tailed Noise
par: Liu, Zijian
Publié: (2026)