Taking the Road Less Scheduled with Adaptive Polyak Steps
Fuente:
arXiv
Guardado en:
| Autores principales: | Oikonomou, Dimitris, Buchholz, Matthew, Pun, Yuen-Man, Gower, Robert M., Loizou, Nicolas |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Adaptive Sharpness-Aware Minimization with a Polyak-type Step size: A Theory-Grounded Scheduler
por: Oikonomou, Dimitris, et al.
Publicado: (2026)
por: Oikonomou, Dimitris, et al.
Publicado: (2026)
Stochastic Polyak Step-sizes and Momentum: Convergence Guarantees and Practical Performance
por: Oikonomou, Dimitris, et al.
Publicado: (2024)
por: Oikonomou, Dimitris, et al.
Publicado: (2024)
Safeguarded Stochastic Polyak Step Sizes for Non-smooth Optimization: Robust Performance Without Small (Sub)Gradients
por: Oikonomou, Dimitris, et al.
Publicado: (2025)
por: Oikonomou, Dimitris, et al.
Publicado: (2025)
Analysis of an Idealized Stochastic Polyak Method and its Application to Black-Box Model Distillation
por: Gower, Robert M., et al.
Publicado: (2025)
por: Gower, Robert M., et al.
Publicado: (2025)
Sharpness-Aware Minimization: General Analysis and Improved Rates
por: Oikonomou, Dimitris, et al.
Publicado: (2025)
por: Oikonomou, Dimitris, et al.
Publicado: (2025)
Enhancing Policy Gradient with the Polyak Step-Size Adaption
por: Li, Yunxiang, et al.
Publicado: (2024)
por: Li, Yunxiang, et al.
Publicado: (2024)
Online Non-Stationary Stochastic Quasar-Convex Optimization
por: Pun, Yuen-Man, et al.
Publicado: (2024)
por: Pun, Yuen-Man, et al.
Publicado: (2024)
The Road Less Scheduled
por: Defazio, Aaron, et al.
Publicado: (2024)
por: Defazio, Aaron, et al.
Publicado: (2024)
Cutting Some Slack for SGD with Adaptive Polyak Stepsizes
por: Gower, Robert M., et al.
Publicado: (2022)
por: Gower, Robert M., et al.
Publicado: (2022)
SANIA: Polyak-type Optimization Framework Leads to Scale Invariant Stochastic Algorithms
por: Abdukhakimov, Farshed, et al.
Publicado: (2023)
por: Abdukhakimov, Farshed, et al.
Publicado: (2023)
Multiplayer Federated Learning: Reaching Equilibrium with Less Communication
por: Yoon, TaeHo, et al.
Publicado: (2025)
por: Yoon, TaeHo, et al.
Publicado: (2025)
Locally Adaptive Federated Learning
por: Mukherjee, Sohom, et al.
Publicado: (2023)
por: Mukherjee, Sohom, et al.
Publicado: (2023)
Constrained Online Convex Optimization with Polyak Feasibility Steps
por: Hutchinson, Spencer, et al.
Publicado: (2025)
por: Hutchinson, Spencer, et al.
Publicado: (2025)
Step-Size Stability in Stochastic Optimization: A Theoretical Perspective
por: Schaipp, Fabian, et al.
Publicado: (2026)
por: Schaipp, Fabian, et al.
Publicado: (2026)
Extragradient Method for $(L_0, L_1)$-Lipschitz Root-finding Problems
por: Choudhury, Sayantan, et al.
Publicado: (2025)
por: Choudhury, Sayantan, et al.
Publicado: (2025)
In Search of Adam's Secret Sauce
por: Orvieto, Antonio, et al.
Publicado: (2025)
por: Orvieto, Antonio, et al.
Publicado: (2025)
Policy Trees for Prediction: Interpretable and Adaptive Model Selection for Machine Learning
por: Bertsimas, Dimitris, et al.
Publicado: (2024)
por: Bertsimas, Dimitris, et al.
Publicado: (2024)
Learning at the Speed of Physics: Equilibrium Propagation on Oscillator Ising Machines
por: Gower, Alex
Publicado: (2025)
por: Gower, Alex
Publicado: (2025)
Minimisation of Quasar-Convex Functions Using Random Zeroth-Order Oracles
por: Farzin, Amir Ali, et al.
Publicado: (2025)
por: Farzin, Amir Ali, et al.
Publicado: (2025)
On the Stability Connection Between Discrete-Time Algorithms and Their Resolution ODEs: Applications to Min-Max Optimisation
por: Farzin, Amir Ali, et al.
Publicado: (2026)
por: Farzin, Amir Ali, et al.
Publicado: (2026)
Directional Smoothness and Gradient Methods: Convergence and Adaptivity
por: Mishkin, Aaron, et al.
Publicado: (2024)
por: Mishkin, Aaron, et al.
Publicado: (2024)
Ruppert-Polyak averaging for Stochastic Order Oracle
por: Smirnov, V. N., et al.
Publicado: (2024)
por: Smirnov, V. N., et al.
Publicado: (2024)
Dynamics of SGD with Stochastic Polyak Stepsizes: Truly Adaptive Variants and Convergence to Exact Solution
por: Orvieto, Antonio, et al.
Publicado: (2022)
por: Orvieto, Antonio, et al.
Publicado: (2022)
Minimisation of Submodular Functions Using Gaussian Zeroth-Order Random Oracles
por: Farzin, Amir Ali, et al.
Publicado: (2025)
por: Farzin, Amir Ali, et al.
Publicado: (2025)
Solving the Offline and Online Min-Max Problem of Non-smooth Submodular-Concave Functions: A Zeroth-Order Approach
por: Farzin, Amir Ali, et al.
Publicado: (2026)
por: Farzin, Amir Ali, et al.
Publicado: (2026)
Adaptive SGD with Line-Search and Polyak Stepsizes: Nonconvex Convergence and Accelerated Rates
por: Wu, Haotian
Publicado: (2025)
por: Wu, Haotian
Publicado: (2025)
Chunked Data Shapley: A Scalable Dataset Quality Assessment for Machine Learning
por: Loizou, Andreas, et al.
Publicado: (2025)
por: Loizou, Andreas, et al.
Publicado: (2025)
Analytics Modelling over Multiple Datasets using Vector Embeddings
por: Loizou, Andreas, et al.
Publicado: (2025)
por: Loizou, Andreas, et al.
Publicado: (2025)
Dynamic Parameter Optimization for Highly Transferable Transformation-Based Attacks
por: Liang, Jiaming, et al.
Publicado: (2025)
por: Liang, Jiaming, et al.
Publicado: (2025)
Cellular Traffic Prediction via Deep State Space Models with Attention Mechanism
por: Ma, Hui, et al.
Publicado: (2025)
por: Ma, Hui, et al.
Publicado: (2025)
Monotone, Bi-Lipschitz, and Polyak-Lojasiewicz Networks
por: Wang, Ruigang, et al.
Publicado: (2024)
por: Wang, Ruigang, et al.
Publicado: (2024)
Level Set Teleportation: An Optimization Perspective
por: Mishkin, Aaron, et al.
Publicado: (2024)
por: Mishkin, Aaron, et al.
Publicado: (2024)
Dissipative Gradient Descent Ascent Method: A Control Theory Inspired Algorithm for Min-max Optimization
por: Zheng, Tianqi, et al.
Publicado: (2024)
por: Zheng, Tianqi, et al.
Publicado: (2024)
Stochastic Extragradient with Random Reshuffling: Improved Convergence for Variational Inequalities
por: Emmanouilidis, Konstantinos, et al.
Publicado: (2024)
por: Emmanouilidis, Konstantinos, et al.
Publicado: (2024)
An Exploration of Non-Euclidean Gradient Descent: Muon and its Many Variants
por: Crawshaw, Michael, et al.
Publicado: (2025)
por: Crawshaw, Michael, et al.
Publicado: (2025)
Adaptive Forests For Classification
por: Bertsimas, Dimitris, et al.
Publicado: (2025)
por: Bertsimas, Dimitris, et al.
Publicado: (2025)
Less is More: Non-uniform Road Segments are Efficient for Bus Arrival Prediction
por: Huang, Zhen, et al.
Publicado: (2025)
por: Huang, Zhen, et al.
Publicado: (2025)
Communication-Efficient Gradient Descent-Accent Methods for Distributed Variational Inequalities: Unified Analysis and Local Updates
por: Zhang, Siqi, et al.
Publicado: (2023)
por: Zhang, Siqi, et al.
Publicado: (2023)
OTI: A Model-free and Visually Interpretable Measure of Image Attackability
por: Liang, Jiaming, et al.
Publicado: (2026)
por: Liang, Jiaming, et al.
Publicado: (2026)
Fisher meets Feynman: score-based variational inference with a product of experts
por: Cai, Diana, et al.
Publicado: (2025)
por: Cai, Diana, et al.
Publicado: (2025)
Ejemplares similares
-
Adaptive Sharpness-Aware Minimization with a Polyak-type Step size: A Theory-Grounded Scheduler
por: Oikonomou, Dimitris, et al.
Publicado: (2026) -
Stochastic Polyak Step-sizes and Momentum: Convergence Guarantees and Practical Performance
por: Oikonomou, Dimitris, et al.
Publicado: (2024) -
Safeguarded Stochastic Polyak Step Sizes for Non-smooth Optimization: Robust Performance Without Small (Sub)Gradients
por: Oikonomou, Dimitris, et al.
Publicado: (2025) -
Analysis of an Idealized Stochastic Polyak Method and its Application to Black-Box Model Distillation
por: Gower, Robert M., et al.
Publicado: (2025) -
Sharpness-Aware Minimization: General Analysis and Improved Rates
por: Oikonomou, Dimitris, et al.
Publicado: (2025)