Gradient Methods with Online Scaling Part I. Theoretical Foundations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gao, Wenzhi, Chu, Ya-Chi, Ye, Yinyu, Udell, Madeleine
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916934114607104
author Gao, Wenzhi
Chu, Ya-Chi
Ye, Yinyu
Udell, Madeleine
author_facet Gao, Wenzhi
Chu, Ya-Chi
Ye, Yinyu
Udell, Madeleine
contents This paper establishes the theoretical foundations of the online scaled gradient methods (OSGM), a framework that utilizes online learning to adapt stepsizes and provably accelerate first-order methods. OSGM quantifies the effectiveness of a stepsize by a feedback function motivated from a convergence measure and uses the feedback to adjust the stepsize through an online learning algorithm. Consequently, instantiations of OSGM achieve convergence rates that are asymptotically no worse than the optimal stepsize. OSGM yields desirable convergence guarantees on smooth convex problems, including 1) trajectory-dependent global convergence on smooth convex objectives; 2) an improved complexity result on smooth strongly convex problems, and 3) local superlinear convergence. Notably, OSGM constitutes a new family of first-order methods with non-asymptotic superlinear convergence, joining the celebrated quasi-Newton methods. Finally, OSGM explains the empirical success of the popular hypergradient-descent heuristic in optimization for machine learning.
format Preprint
id arxiv_https___arxiv_org_abs_2505_23081
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Gradient Methods with Online Scaling Part I. Theoretical Foundations
Gao, Wenzhi
Chu, Ya-Chi
Ye, Yinyu
Udell, Madeleine
Optimization and Control
Machine Learning
This paper establishes the theoretical foundations of the online scaled gradient methods (OSGM), a framework that utilizes online learning to adapt stepsizes and provably accelerate first-order methods. OSGM quantifies the effectiveness of a stepsize by a feedback function motivated from a convergence measure and uses the feedback to adjust the stepsize through an online learning algorithm. Consequently, instantiations of OSGM achieve convergence rates that are asymptotically no worse than the optimal stepsize. OSGM yields desirable convergence guarantees on smooth convex problems, including 1) trajectory-dependent global convergence on smooth convex objectives; 2) an improved complexity result on smooth strongly convex problems, and 3) local superlinear convergence. Notably, OSGM constitutes a new family of first-order methods with non-asymptotic superlinear convergence, joining the celebrated quasi-Newton methods. Finally, OSGM explains the empirical success of the popular hypergradient-descent heuristic in optimization for machine learning.
title Gradient Methods with Online Scaling Part I. Theoretical Foundations
topic Optimization and Control
Machine Learning
url https://arxiv.org/abs/2505.23081