Imagen de Portada

Taking the Road Less Scheduled with Adaptive Polyak Steps

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Oikonomou, Dimitris, Buchholz, Matthew, Pun, Yuen-Man, Gower, Robert M., Loizou, Nicolas
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Adaptive Sharpness-Aware Minimization with a Polyak-type Step size: A Theory-Grounded Scheduler
por: Oikonomou, Dimitris, et al.
Publicado: (2026)

Stochastic Polyak Step-sizes and Momentum: Convergence Guarantees and Practical Performance
por: Oikonomou, Dimitris, et al.
Publicado: (2024)

Safeguarded Stochastic Polyak Step Sizes for Non-smooth Optimization: Robust Performance Without Small (Sub)Gradients
por: Oikonomou, Dimitris, et al.
Publicado: (2025)

Analysis of an Idealized Stochastic Polyak Method and its Application to Black-Box Model Distillation
por: Gower, Robert M., et al.
Publicado: (2025)

Sharpness-Aware Minimization: General Analysis and Improved Rates
por: Oikonomou, Dimitris, et al.
Publicado: (2025)

Enhancing Policy Gradient with the Polyak Step-Size Adaption
por: Li, Yunxiang, et al.
Publicado: (2024)

Online Non-Stationary Stochastic Quasar-Convex Optimization
por: Pun, Yuen-Man, et al.
Publicado: (2024)

The Road Less Scheduled
por: Defazio, Aaron, et al.
Publicado: (2024)

Cutting Some Slack for SGD with Adaptive Polyak Stepsizes
por: Gower, Robert M., et al.
Publicado: (2022)

SANIA: Polyak-type Optimization Framework Leads to Scale Invariant Stochastic Algorithms
por: Abdukhakimov, Farshed, et al.
Publicado: (2023)

Multiplayer Federated Learning: Reaching Equilibrium with Less Communication
por: Yoon, TaeHo, et al.
Publicado: (2025)

Locally Adaptive Federated Learning
por: Mukherjee, Sohom, et al.
Publicado: (2023)

Constrained Online Convex Optimization with Polyak Feasibility Steps
por: Hutchinson, Spencer, et al.
Publicado: (2025)

Step-Size Stability in Stochastic Optimization: A Theoretical Perspective
por: Schaipp, Fabian, et al.
Publicado: (2026)

Extragradient Method for $(L_0, L_1)$-Lipschitz Root-finding Problems
por: Choudhury, Sayantan, et al.
Publicado: (2025)

In Search of Adam's Secret Sauce
por: Orvieto, Antonio, et al.
Publicado: (2025)

Policy Trees for Prediction: Interpretable and Adaptive Model Selection for Machine Learning
por: Bertsimas, Dimitris, et al.
Publicado: (2024)

Learning at the Speed of Physics: Equilibrium Propagation on Oscillator Ising Machines
por: Gower, Alex
Publicado: (2025)

Minimisation of Quasar-Convex Functions Using Random Zeroth-Order Oracles
por: Farzin, Amir Ali, et al.
Publicado: (2025)

On the Stability Connection Between Discrete-Time Algorithms and Their Resolution ODEs: Applications to Min-Max Optimisation
por: Farzin, Amir Ali, et al.
Publicado: (2026)

Directional Smoothness and Gradient Methods: Convergence and Adaptivity
por: Mishkin, Aaron, et al.
Publicado: (2024)

Ruppert-Polyak averaging for Stochastic Order Oracle
por: Smirnov, V. N., et al.
Publicado: (2024)

Dynamics of SGD with Stochastic Polyak Stepsizes: Truly Adaptive Variants and Convergence to Exact Solution
por: Orvieto, Antonio, et al.
Publicado: (2022)

Minimisation of Submodular Functions Using Gaussian Zeroth-Order Random Oracles
por: Farzin, Amir Ali, et al.
Publicado: (2025)

Solving the Offline and Online Min-Max Problem of Non-smooth Submodular-Concave Functions: A Zeroth-Order Approach
por: Farzin, Amir Ali, et al.
Publicado: (2026)

Adaptive SGD with Line-Search and Polyak Stepsizes: Nonconvex Convergence and Accelerated Rates
por: Wu, Haotian
Publicado: (2025)

Chunked Data Shapley: A Scalable Dataset Quality Assessment for Machine Learning
por: Loizou, Andreas, et al.
Publicado: (2025)

Analytics Modelling over Multiple Datasets using Vector Embeddings
por: Loizou, Andreas, et al.
Publicado: (2025)

Dynamic Parameter Optimization for Highly Transferable Transformation-Based Attacks
por: Liang, Jiaming, et al.
Publicado: (2025)

Cellular Traffic Prediction via Deep State Space Models with Attention Mechanism
por: Ma, Hui, et al.
Publicado: (2025)

Monotone, Bi-Lipschitz, and Polyak-Lojasiewicz Networks
por: Wang, Ruigang, et al.
Publicado: (2024)

Level Set Teleportation: An Optimization Perspective
por: Mishkin, Aaron, et al.
Publicado: (2024)

Dissipative Gradient Descent Ascent Method: A Control Theory Inspired Algorithm for Min-max Optimization
por: Zheng, Tianqi, et al.
Publicado: (2024)

Stochastic Extragradient with Random Reshuffling: Improved Convergence for Variational Inequalities
por: Emmanouilidis, Konstantinos, et al.
Publicado: (2024)

An Exploration of Non-Euclidean Gradient Descent: Muon and its Many Variants
por: Crawshaw, Michael, et al.
Publicado: (2025)

Adaptive Forests For Classification
por: Bertsimas, Dimitris, et al.
Publicado: (2025)

Less is More: Non-uniform Road Segments are Efficient for Bus Arrival Prediction
por: Huang, Zhen, et al.
Publicado: (2025)

Communication-Efficient Gradient Descent-Accent Methods for Distributed Variational Inequalities: Unified Analysis and Local Updates
por: Zhang, Siqi, et al.
Publicado: (2023)

OTI: A Model-free and Visually Interpretable Measure of Image Attackability
por: Liang, Jiaming, et al.
Publicado: (2026)

Fisher meets Feynman: score-based variational inference with a product of experts
por: Cai, Diana, et al.
Publicado: (2025)