Towards Fully Parameter-Free Stochastic Optimization: Grid Search with Self-Bounding Analysis

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhao, Yuheng, Yan, Yu-Hu, Attia, Amit, Koren, Tomer, Zhang, Lijun, Zhao, Peng
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning Optimization and Control
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

How Free is Parameter-Free Stochastic Optimization?
di: Attia, Amit, et al.
Pubblicazione: (2024)

Learning Rate Annealing Improves Tuning Robustness in Stochastic Optimization
di: Attia, Amit, et al.
Pubblicazione: (2025)

Faster Stochastic Optimization with Arbitrary Delays via Asynchronous Mini-Batching
di: Attia, Amit, et al.
Pubblicazione: (2024)

Fast Last-Iterate Convergence of SGD in the Smooth Interpolation Regime
di: Attia, Amit, et al.
Pubblicazione: (2025)

Rapid Overfitting of Multi-Pass Stochastic Gradient Descent in Stochastic Convex Optimization
di: Vansover-Hager, Shira, et al.
Pubblicazione: (2025)

Gradient-Variation Online Adaptivity for Accelerated Optimization with Hölder Smoothness
di: Zhao, Yuheng, et al.
Pubblicazione: (2025)

Accelerated Parameter-Free Stochastic Optimization
di: Kreisler, Itai, et al.
Pubblicazione: (2024)

Convergence of Policy Mirror Descent Beyond Compatible Function Approximation
di: Sherman, Uri, et al.
Pubblicazione: (2025)

Convergence and Sample Complexity of First-Order Methods for Agnostic Reinforcement Learning
di: Sherman, Uri, et al.
Pubblicazione: (2025)

The Sample Complexity of Parameter-Free Stochastic Convex Optimization
di: Lawrence, Jared, et al.
Pubblicazione: (2025)

Parameter-free Algorithms for the Stochastically Extended Adversarial Model
di: Wang, Shuche, et al.
Pubblicazione: (2025)

Projection-Free Variance Reduction Methods for Stochastic Constrained Multi-Level Compositional Optimization
di: Jiang, Wei, et al.
Pubblicazione: (2024)

Universal Online Convex Optimization with $1$ Projection per Round
di: Yang, Wenhao, et al.
Pubblicazione: (2024)

Efficient Stochastic Approximation of Minimax Excess Risk Optimization
di: Zhang, Lijun, et al.
Pubblicazione: (2023)

Problem-Parameter-Free Decentralized Bilevel Optimization
di: Zhai, Zhiwei, et al.
Pubblicazione: (2025)

Adaptivity and Universality: Problem-dependent Universal Regret for Online Convex Optimization
di: Zhao, Peng, et al.
Pubblicazione: (2025)

Stochastic Optimization with Random Search
di: Chayti, El Mahdi, et al.
Pubblicazione: (2025)

Tuning-Free Stochastic Optimization
di: Khaled, Ahmed, et al.
Pubblicazione: (2024)

Adaptive Variance Reduction for Stochastic Optimization under Weaker Assumptions
di: Jiang, Wei, et al.
Pubblicazione: (2024)

Universal Online Convex Optimization Meets Second-order Bounds
di: Zhang, Lijun, et al.
Pubblicazione: (2021)

Convergence Analysis of the Lion Optimizer in Centralized and Distributed Settings
di: Jiang, Wei, et al.
Pubblicazione: (2025)

Stochastic Approximation Methods for Distortion Risk Measure Optimization
di: Jiang, Jinyang, et al.
Pubblicazione: (2025)

Stochastic Constrained Decentralized Optimization for Machine Learning with Fewer Data Oracles: a Gradient Sliding Approach
di: Nguyen, Hoang Huy, et al.
Pubblicazione: (2024)

Sign-SGD via Parameter-Free Optimization
di: Medyakov, Daniil, et al.
Pubblicazione: (2025)

Variance-Aware Regret Bounds for Stochastic Contextual Dueling Bandits
di: Di, Qiwei, et al.
Pubblicazione: (2023)

Optimistic Online-to-Batch Conversions for Accelerated Convergence and Universality
di: Yan, Yu-Hu, et al.
Pubblicazione: (2025)

Universal Online Learning with Gradient Variations: A Multi-layer Online Ensemble Approach
di: Yan, Yu-Hu, et al.
Pubblicazione: (2023)

Bridging Constraints and Stochasticity: A Fully First-Order Method for Stochastic Bilevel Optimization with Linear Constraints
di: Phan, Cac, et al.
Pubblicazione: (2025)

A General Reduction for High-Probability Analysis with General Light-Tailed Distributions
di: Attia, Amit, et al.
Pubblicazione: (2024)

Towards Weaker Variance Assumptions for Stochastic Optimization
di: Alacaoglu, Ahmet, et al.
Pubblicazione: (2025)

Towards Simple and Provable Parameter-Free Adaptive Gradient Methods
di: Tao, Yuanzhe, et al.
Pubblicazione: (2024)

Accelerating Distributed Stochastic Optimization via Self-Repellent Random Walks
di: Hu, Jie, et al.
Pubblicazione: (2024)

Learning-Rate-Free Stochastic Optimization over Riemannian Manifolds
di: Dodd, Daniel, et al.
Pubblicazione: (2024)

Faster Gradient-Free Algorithms for Nonsmooth Nonconvex Stochastic Optimization
di: Chen, Lesi, et al.
Pubblicazione: (2023)

New Lower Bounds for Stochastic Non-Convex Optimization through Divergence Decomposition
di: Saad, El Mehdi, et al.
Pubblicazione: (2025)

Non-Asymptotic Optimization and Generalization Bounds for Stochastic Gauss-Newton in Overparameterized Models
di: Cayci, Semih
Pubblicazione: (2025)

A Multi-objective Newton Optimization Algorithm for Hyper-Parameter Search
di: Xu, Qinwu
Pubblicazione: (2024)

Dynamic Regret via Discounted-to-Dynamic Reduction with Applications to Curved Losses and Adam Optimizer
di: Xie, Yan-Feng, et al.
Pubblicazione: (2026)

Fully Stochastic Trust-Region Sequential Quadratic Programming for Equality-Constrained Optimization Problems
di: Fang, Yuchen, et al.
Pubblicazione: (2022)

SketchySGD: Reliable Stochastic Optimization via Randomized Curvature Estimates
di: Frangella, Zachary, et al.
Pubblicazione: (2022)