Copertina

Adaptive Variance Reduction for Stochastic Optimization under Weaker Assumptions

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Jiang, Wei, Yang, Sifan, Wang, Yibo, Zhang, Lijun
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Optimization and Control Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Towards Weaker Variance Assumptions for Stochastic Optimization
di: Alacaoglu, Ahmet, et al.
Pubblicazione: (2025)

Projection-Free Variance Reduction Methods for Stochastic Constrained Multi-Level Compositional Optimization
di: Jiang, Wei, et al.
Pubblicazione: (2024)

Efficient Sign-Based Optimization: Accelerating Convergence via Variance Reduction
di: Jiang, Wei, et al.
Pubblicazione: (2024)

Byzantine-Robust and Differentially Private Federated Optimization under Weaker Assumptions
di: Islamov, Rustem, et al.
Pubblicazione: (2026)

Infeasible Deterministic, Stochastic, and Variance-Reduction Algorithms for Optimization under Orthogonality Constraints
di: Ablin, Pierre, et al.
Pubblicazione: (2023)

Solving Stochastic Variational Inequalities without the Bounded Variance Assumption
di: Alacaoglu, Ahmet, et al.
Pubblicazione: (2026)

On Convergence of Adam for Stochastic Optimization under Relaxed Assumptions
di: Hong, Yusu, et al.
Pubblicazione: (2024)

TRSVR: An Adaptive Stochastic Trust-Region Method with Variance Reduction
di: Fang, Yuchen, et al.
Pubblicazione: (2026)

Improved Analysis for Sign-based Methods with Momentum Updates
di: Jiang, Wei, et al.
Pubblicazione: (2025)

Universal Online Convex Optimization with $1$ Projection per Round
di: Yang, Wenhao, et al.
Pubblicazione: (2024)

Stochastic Gradient Langevin Dynamics with Variance Reduction
di: Huang, Zhishen, et al.
Pubblicazione: (2021)

Decentralized Non-convex Stochastic Optimization with Heterogeneous Variance
di: Chen, Hongxu, et al.
Pubblicazione: (2026)

Variance Reduction and Low Sample Complexity in Stochastic Optimization via Proximal Point Method
di: Liang, Jiaming
Pubblicazione: (2024)

Efficient Stochastic Approximation of Minimax Excess Risk Optimization
di: Zhang, Lijun, et al.
Pubblicazione: (2023)

Universal Online Convex Optimization Meets Second-order Bounds
di: Zhang, Lijun, et al.
Pubblicazione: (2021)

Gradient Estimation and Variance Reduction in Stochastic and Deterministic Models
di: Keane, Ronan
Pubblicazione: (2024)

Convergence Analysis of the Lion Optimizer in Centralized and Distributed Settings
di: Jiang, Wei, et al.
Pubblicazione: (2025)

On the Stochastic (Variance-Reduced) Proximal Gradient Method for Regularized Expected Reward Optimization
di: Liang, Ling, et al.
Pubblicazione: (2024)

Breaking the Stochasticity Barrier: An Adaptive Variance-Reduced Method for Variational Inequalities
di: Jeong, Yungi, et al.
Pubblicazione: (2026)

Adaptive Optimization via Momentum on Variance-Normalized Gradients
di: Patitucci, Francisco, et al.
Pubblicazione: (2026)

A Variance-Reduced Stochastic Gradient Tracking Algorithm for Decentralized Optimization with Orthogonality Constraints
di: Wang, Lei, et al.
Pubblicazione: (2022)

Drago: Primal-Dual Coupled Variance Reduction for Faster Distributionally Robust Optimization
di: Mehta, Ronak, et al.
Pubblicazione: (2024)

Beyond Bounded Variance: Variance-Reduced Normalized Methods for Nonconvex Optimization under Blum-Gladyshev Noise
di: Upadhyay, Antesh, et al.
Pubblicazione: (2026)

PPI-SVRG: Unifying Prediction-Powered Inference and Variance Reduction for Semi-Supervised Optimization
di: Ao, Ruicheng, et al.
Pubblicazione: (2026)

Double Variance Reduction: A Smoothing Trick for Composite Optimization Problems without First-Order Gradient
di: Di, Hao, et al.
Pubblicazione: (2024)

Global Convergence of Natural Policy Gradient with Hessian-aided Momentum Variance Reduction
di: Feng, Jie, et al.
Pubblicazione: (2024)

Muon is Provably Faster with Momentum Variance Reduction
di: Qian, Xun, et al.
Pubblicazione: (2025)

Stochastic Compositional Optimization with Compositional Constraints
di: Yang, Shuoguang, et al.
Pubblicazione: (2022)

The Price of Adaptivity in Stochastic Convex Optimization
di: Carmon, Yair, et al.
Pubblicazione: (2024)

MARS-M: When Variance Reduction Meets Matrices
di: Liu, Yifeng, et al.
Pubblicazione: (2025)

Prescriptive PCA: Dimensionality Reduction for Two-stage Stochastic Optimization
di: He, Long, et al.
Pubblicazione: (2023)

Adaptive Gradient Normalization and Independent Sampling for (Stochastic) Generalized-Smooth Optimization
di: Yang, Yufeng, et al.
Pubblicazione: (2024)

Towards Fully Parameter-Free Stochastic Optimization: Grid Search with Self-Bounding Analysis
di: Zhao, Yuheng, et al.
Pubblicazione: (2026)

Complexity Lower Bounds of Adaptive Gradient Algorithms for Non-convex Stochastic Optimization under Relaxed Smoothness
di: Crawshaw, Michael, et al.
Pubblicazione: (2025)

MARS: Unleashing the Power of Variance Reduction for Training Large Models
di: Yuan, Huizhuo, et al.
Pubblicazione: (2024)

Variance-Aware Regret Bounds for Stochastic Contextual Dueling Bandits
di: Di, Qiwei, et al.
Pubblicazione: (2023)

VAMO: Efficient Zeroth-Order Variance Reduction for SGD with Faster Convergence
di: Chen, Jiahe, et al.
Pubblicazione: (2025)

Policy-based Primal-Dual Methods for Concave CMDP with Variance Reduction
di: Ying, Donghao, et al.
Pubblicazione: (2022)

Unified Convergence Theory of Stochastic and Variance-Reduced Cubic Newton Methods
di: Chayti, El Mahdi, et al.
Pubblicazione: (2023)

Decentralized Stochastic Nonconvex Optimization under the Relaxed Smoothness
di: Luo, Luo, et al.
Pubblicazione: (2025)