Cover Image

Taking the Road Less Scheduled with Adaptive Polyak Steps

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Oikonomou, Dimitris, Buchholz, Matthew, Pun, Yuen-Man, Gower, Robert M., Loizou, Nicolas
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Adaptive Sharpness-Aware Minimization with a Polyak-type Step size: A Theory-Grounded Scheduler
by: Oikonomou, Dimitris, et al.
Published: (2026)

Stochastic Polyak Step-sizes and Momentum: Convergence Guarantees and Practical Performance
by: Oikonomou, Dimitris, et al.
Published: (2024)

Safeguarded Stochastic Polyak Step Sizes for Non-smooth Optimization: Robust Performance Without Small (Sub)Gradients
by: Oikonomou, Dimitris, et al.
Published: (2025)

Analysis of an Idealized Stochastic Polyak Method and its Application to Black-Box Model Distillation
by: Gower, Robert M., et al.
Published: (2025)

Sharpness-Aware Minimization: General Analysis and Improved Rates
by: Oikonomou, Dimitris, et al.
Published: (2025)

Enhancing Policy Gradient with the Polyak Step-Size Adaption
by: Li, Yunxiang, et al.
Published: (2024)

Online Non-Stationary Stochastic Quasar-Convex Optimization
by: Pun, Yuen-Man, et al.
Published: (2024)

The Road Less Scheduled
by: Defazio, Aaron, et al.
Published: (2024)

Cutting Some Slack for SGD with Adaptive Polyak Stepsizes
by: Gower, Robert M., et al.
Published: (2022)

SANIA: Polyak-type Optimization Framework Leads to Scale Invariant Stochastic Algorithms
by: Abdukhakimov, Farshed, et al.
Published: (2023)

Multiplayer Federated Learning: Reaching Equilibrium with Less Communication
by: Yoon, TaeHo, et al.
Published: (2025)

Locally Adaptive Federated Learning
by: Mukherjee, Sohom, et al.
Published: (2023)

Constrained Online Convex Optimization with Polyak Feasibility Steps
by: Hutchinson, Spencer, et al.
Published: (2025)

Step-Size Stability in Stochastic Optimization: A Theoretical Perspective
by: Schaipp, Fabian, et al.
Published: (2026)

Extragradient Method for $(L_0, L_1)$-Lipschitz Root-finding Problems
by: Choudhury, Sayantan, et al.
Published: (2025)

In Search of Adam's Secret Sauce
by: Orvieto, Antonio, et al.
Published: (2025)

Policy Trees for Prediction: Interpretable and Adaptive Model Selection for Machine Learning
by: Bertsimas, Dimitris, et al.
Published: (2024)

Learning at the Speed of Physics: Equilibrium Propagation on Oscillator Ising Machines
by: Gower, Alex
Published: (2025)

Minimisation of Quasar-Convex Functions Using Random Zeroth-Order Oracles
by: Farzin, Amir Ali, et al.
Published: (2025)

On the Stability Connection Between Discrete-Time Algorithms and Their Resolution ODEs: Applications to Min-Max Optimisation
by: Farzin, Amir Ali, et al.
Published: (2026)

Directional Smoothness and Gradient Methods: Convergence and Adaptivity
by: Mishkin, Aaron, et al.
Published: (2024)

Ruppert-Polyak averaging for Stochastic Order Oracle
by: Smirnov, V. N., et al.
Published: (2024)

Dynamics of SGD with Stochastic Polyak Stepsizes: Truly Adaptive Variants and Convergence to Exact Solution
by: Orvieto, Antonio, et al.
Published: (2022)

Minimisation of Submodular Functions Using Gaussian Zeroth-Order Random Oracles
by: Farzin, Amir Ali, et al.
Published: (2025)

Solving the Offline and Online Min-Max Problem of Non-smooth Submodular-Concave Functions: A Zeroth-Order Approach
by: Farzin, Amir Ali, et al.
Published: (2026)

Adaptive SGD with Line-Search and Polyak Stepsizes: Nonconvex Convergence and Accelerated Rates
by: Wu, Haotian
Published: (2025)

Chunked Data Shapley: A Scalable Dataset Quality Assessment for Machine Learning
by: Loizou, Andreas, et al.
Published: (2025)

Analytics Modelling over Multiple Datasets using Vector Embeddings
by: Loizou, Andreas, et al.
Published: (2025)

Dynamic Parameter Optimization for Highly Transferable Transformation-Based Attacks
by: Liang, Jiaming, et al.
Published: (2025)

Cellular Traffic Prediction via Deep State Space Models with Attention Mechanism
by: Ma, Hui, et al.
Published: (2025)

Monotone, Bi-Lipschitz, and Polyak-Lojasiewicz Networks
by: Wang, Ruigang, et al.
Published: (2024)

Level Set Teleportation: An Optimization Perspective
by: Mishkin, Aaron, et al.
Published: (2024)

Dissipative Gradient Descent Ascent Method: A Control Theory Inspired Algorithm for Min-max Optimization
by: Zheng, Tianqi, et al.
Published: (2024)

Stochastic Extragradient with Random Reshuffling: Improved Convergence for Variational Inequalities
by: Emmanouilidis, Konstantinos, et al.
Published: (2024)

An Exploration of Non-Euclidean Gradient Descent: Muon and its Many Variants
by: Crawshaw, Michael, et al.
Published: (2025)

Adaptive Forests For Classification
by: Bertsimas, Dimitris, et al.
Published: (2025)

Less is More: Non-uniform Road Segments are Efficient for Bus Arrival Prediction
by: Huang, Zhen, et al.
Published: (2025)

Communication-Efficient Gradient Descent-Accent Methods for Distributed Variational Inequalities: Unified Analysis and Local Updates
by: Zhang, Siqi, et al.
Published: (2023)

OTI: A Model-free and Visually Interpretable Measure of Image Attackability
by: Liang, Jiaming, et al.
Published: (2026)

Fisher meets Feynman: score-based variational inference with a product of experts
by: Cai, Diana, et al.
Published: (2025)