Imagen de Portada

Accelerated Gradient Descent by Concatenation of Stepsize Schedules

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zhang, Zehao, Jiang, Rujun
Formato:	Preprint
Publicado:	2024
Materias:	Optimization and Control
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Composing Optimized Stepsize Schedules for Gradient Descent
por: Grimmer, Benjamin, et al.
Publicado: (2024)

Acceleration by Stepsize Hedging I: Multi-Step Descent and the Silver Stepsize Schedule
por: Altschuler, Jason M., et al.
Publicado: (2023)

Accelerating Proximal Gradient Descent via Silver Stepsizes
por: Bok, Jinho, et al.
Publicado: (2024)

Stepsize Hedging: an Alternative Mechanism for Accelerating Gradient Descent
por: Altschuler, Jason M., et al.
Publicado: (2026)

Acceleration by Stepsize Hedging II: Silver Stepsize Schedule for Smooth Convex Optimization
por: Altschuler, Jason M., et al.
Publicado: (2023)

Acceleration by Random Stepsizes: Hedging, Equalization, and the Arcsine Stepsize Schedule
por: Altschuler, Jason M., et al.
Publicado: (2024)

Block Acceleration Without Momentum: On Optimal Stepsizes of Block Gradient Descent for Least-Squares
por: Peng, Liangzu, et al.
Publicado: (2024)

A Strengthened Conjecture on the Minimax Optimal Constant Stepsize for Gradient Descent
por: Grimmer, Benjamin, et al.
Publicado: (2024)

Coupling-based Convergence Diagnostic and Stepsize Scheme for Stochastic Gradient Descent
por: Li, Xiang, et al.
Publicado: (2024)

Negative Stepsizes Make Gradient-Descent-Ascent Converge
por: Shugart, Henry, et al.
Publicado: (2025)

Generalization of Silver Stepsize Schedule to Stochastic Optimization
por: Bai, Luwei, et al.
Publicado: (2025)

Anytime Acceleration of Gradient Descent
por: Zhang, Zihan, et al.
Publicado: (2024)

Det-CGD: Compressed Gradient Descent with Matrix Stepsizes for Non-Convex Optimization
por: Li, Hanmin, et al.
Publicado: (2023)

Accelerating Level-Value Adjustment for the Polyak Stepsize
por: Liu, Anbang, et al.
Publicado: (2023)

Large Stepsize Gradient Descent for Non-Homogeneous Two-Layer Networks: Margin Improvement and Fast Optimization
por: Cai, Yuhang, et al.
Publicado: (2024)

Linear Convergence of the Proximal Gradient Method for Composite Optimization Under the Polyak-Łojasiewicz Inequality and Its Variant
por: Kong, Qingyuan, et al.
Publicado: (2024)

Universality of AdaGrad Stepsizes for Stochastic Optimization: Inexact Oracle, Acceleration and Variance Reduction
por: Rodomanov, Anton, et al.
Publicado: (2024)

Adaptive Accelerated Gradient Descent Methods for Convex Optimization
por: Xu, Zeyi, et al.
Publicado: (2026)

Accelerated Objective Gap and Gradient Norm Convergence for Gradient Descent via Long Steps
por: Grimmer, Benjamin, et al.
Publicado: (2024)

AdGT: Decentralized Gradient Tracking with Tuning-free Per-Agent Stepsize
por: Ghaderyan, Diyako, et al.
Publicado: (2025)

A Nesterov-style Accelerated Gradient Descent Algorithm for the Symmetric Eigenvalue Problem
por: Alimisis, Foivos, et al.
Publicado: (2024)

Decentralized Relaxed Smooth Optimization with Gradient Descent Methods
por: Jiang, Zhanhong, et al.
Publicado: (2025)

New notions of simultaneous diagonalizability of quadratic forms with applications to QCQPs
por: Wang, Alex L., et al.
Publicado: (2021)

Solving Chance Constrained Programs via a Penalty based Difference of Convex Approach
por: Li, Zhiping, et al.
Publicado: (2026)

Natural Gradient Descent for Control
por: Esmzad, Ramin, et al.
Publicado: (2025)

New Results on the Polyak Stepsize: Tight Convergence Analysis and Universal Function Classes
por: He, Chang, et al.
Publicado: (2025)

An Adaptive Stochastic Gradient Method with Non-negative Gauss-Newton Stepsizes
por: Orvieto, Antonio, et al.
Publicado: (2024)

Faster Convergence of Stochastic Accelerated Gradient Descent under Interpolation
por: Mishkin, Aaron, et al.
Publicado: (2024)

Stochastic Approximation with Block Coordinate Optimal Stepsizes
por: Jiang, Tao, et al.
Publicado: (2025)

Stochastic Gradient Descent with Strategic Querying
por: Jiang, Nanfei, et al.
Publicado: (2025)

Interpretable Gradient Descent for Kalman Gain
por: Belabbas, M. A., et al.
Publicado: (2025)

Near-Optimal Convex Simple Bilevel Optimization with a Bisection Method
por: Wang, Jiulin, et al.
Publicado: (2024)

An Adaptive Algorithm for Bilevel Optimization on Riemannian Manifolds
por: Shi, Xu, et al.
Publicado: (2025)

An Alternating Direction Method of Multipliers for Utility-based Shortfall Risk Portfolio Optimization
por: Xiao, Rufeng, et al.
Publicado: (2025)

Towards Noise-adaptive, Problem-adaptive (Accelerated) Stochastic Gradient Descent
por: Vaswani, Sharan, et al.
Publicado: (2021)

Perturbed Gradient Descent Algorithms are Small-Disturbance Input-to-State Stable
por: Cui, Leilei, et al.
Publicado: (2025)

SOREL: A Stochastic Algorithm for Spectral Risks Minimization
por: Ge, Yuze, et al.
Publicado: (2024)

Adaptive SGD with Line-Search and Polyak Stepsizes: Nonconvex Convergence and Accelerated Rates
por: Wu, Haotian
Publicado: (2025)

Adaptive Stepsize Selection in Decentralized Convex Optimization
por: Kuruzov, Ilya, et al.
Publicado: (2025)

Projected Gradient Descent Algorithm for Low-Rank Matrix Estimation
por: Zhang, Teng, et al.
Publicado: (2024)