Image de couverture de livre

Optimistic Online-to-Batch Conversions for Accelerated Convergence and Universality

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Yan, Yu-Hu, Zhao, Peng, Zhou, Zhi-Hua
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Optimization and Control
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Universal Online Learning with Gradient Variations: A Multi-layer Online Ensemble Approach
par: Yan, Yu-Hu, et autres
Publié: (2023)

Adaptivity and Universality: Problem-dependent Universal Regret for Online Convex Optimization
par: Zhao, Peng, et autres
Publié: (2025)

Gradient-Variation Online Learning under Generalized Smoothness
par: Xie, Yan-Feng, et autres
Publié: (2024)

Gradient-Variation Online Adaptivity for Accelerated Optimization with Hölder Smoothness
par: Zhao, Yuheng, et autres
Publié: (2025)

A Simple, Optimal and Efficient Algorithm for Online Exp-Concave Optimization
par: Wang, Yi-Han, et autres
Publié: (2025)

Optimistic Online LQR via Intrinsic Rewards
par: Bartos, Marcell, et autres
Publié: (2026)

Optimistic Online Non-stochastic Control via FTRL
par: Mhaisen, Naram, et autres
Publié: (2024)

An Optimistic Algorithm for Online Convex Optimization with Adversarial Constraints
par: Lekeufack, Jordan, et autres
Publié: (2024)

Optimistic Safety for Online Convex Optimization with Unknown Linear Constraints
par: Hutchinson, Spencer, et autres
Publié: (2024)

Dynamic Regret via Discounted-to-Dynamic Reduction with Applications to Curved Losses and Adam Optimizer
par: Xie, Yan-Feng, et autres
Publié: (2026)

Online Linear Programming with Batching
par: Xu, Haoran, et autres
Publié: (2024)

Omega: Optimistic EMA Gradients
par: Ramirez, Juan, et autres
Publié: (2023)

On Stability in Optimistic Bilevel Optimization
par: Royset, Johannes O.
Publié: (2024)

Faster Convergence of Riemannian Stochastic Gradient Descent with Increasing Batch Size
par: Oowada, Kanata, et autres
Publié: (2025)

Universal Online Convex Optimization with $1$ Projection per Round
par: Yang, Wenhao, et autres
Publié: (2024)

Tail Distribution of Regret in Optimistic Reinforcement Learning
par: Khodadadian, Sajad, et autres
Publié: (2025)

Adam-HNAG: A Convergent Reformulation of Adam with Accelerated Rate
par: Yu, Yaxin, et autres
Publié: (2026)

Optimistic Online Learning in Symmetric Cone Games
par: Barakat, Anas, et autres
Publié: (2025)

Layer-wise Quantization for Quantized Optimistic Dual Averaging
par: Nguyen, Anh Duc, et autres
Publié: (2025)

Increasing Both Batch Size and Learning Rate Accelerates Stochastic Gradient Descent
par: Umeda, Hikaru, et autres
Publié: (2024)

Stochastic Variance-Reduced Newton: Accelerating Finite-Sum Minimization with Large Batches
par: Dereziński, Michał
Publié: (2022)

Both Asymptotic and Non-Asymptotic Convergence of Quasi-Hyperbolic Momentum using Increasing Batch Size
par: Imaizumi, Kento, et autres
Publié: (2025)

Convergence of Sharpness-Aware Minimization Algorithms using Increasing Batch Size and Decaying Learning Rate
par: Harada, Hinata, et autres
Publié: (2024)

The Limit Points of (Optimistic) Gradient Descent in Min-Max Optimization
par: Daskalakis, Constantinos, et autres
Publié: (2018)

Adaptive and Optimal Second-order Optimistic Methods for Minimax Optimization
par: Jiang, Ruichen, et autres
Publié: (2024)

Dual Optimistic Ascent (PI Control) is the Augmented Lagrangian Method in Disguise
par: Ramirez, Juan, et autres
Publié: (2025)

Randomized Block-Coordinate Optimistic Gradient Algorithms for Root-Finding Problems
par: Tran-Dinh, Quoc, et autres
Publié: (2023)

Theoretical Analysis on how Learning Rate Warmup Accelerates Convergence
par: Liu, Yuxing, et autres
Publié: (2025)

Faster Convergence of Stochastic Accelerated Gradient Descent under Interpolation
par: Mishkin, Aaron, et autres
Publié: (2024)

AdaBatchGrad: Combining Adaptive Batch Size and Adaptive Step Size
par: Ostroukhov, Petr, et autres
Publié: (2024)

Efficient Sign-Based Optimization: Accelerating Convergence via Variance Reduction
par: Jiang, Wei, et autres
Publié: (2024)

VFOG: Variance-Reduced Fast Optimistic Gradient Methods for a Class of Nonmonotone Generalized Equations
par: Tran-Dinh, Quoc, et autres
Publié: (2025)

Improving Convergence and Generalization Using Parameter Symmetries
par: Zhao, Bo, et autres
Publié: (2023)

Adaptive SGD with Line-Search and Polyak Stepsizes: Nonconvex Convergence and Accelerated Rates
par: Wu, Haotian
Publié: (2025)

Accelerated Convergence of Stochastic Heavy Ball Method under Anisotropic Gradient Noise
par: Pan, Rui, et autres
Publié: (2023)

Provable Accelerated Convergence of Nesterov's Momentum for Deep ReLU Neural Networks
par: Liao, Fangshuo, et autres
Publié: (2023)

Online Learning Guided Quasi-Newton Methods with Global Non-Asymptotic Convergence
par: Jiang, Ruichen, et autres
Publié: (2024)

Seesaw: Accelerating Training by Balancing Learning Rate and Batch Size Scheduling
par: Meterez, Alexandru, et autres
Publié: (2025)

Accelerated Optimization Landscape of Linear-Quadratic Regulator
par: Feng, Lechen, et autres
Publié: (2023)

Towards Fully Parameter-Free Stochastic Optimization: Grid Search with Self-Bounding Analysis
par: Zhao, Yuheng, et autres
Publié: (2026)