Image de couverture de livre

Beyond Bounded Variance: Variance-Reduced Normalized Methods for Nonconvex Optimization under Blum-Gladyshev Noise

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Upadhyay, Antesh, Fazla, Arda, Hashemi, Abolfazl
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning Optimization and Control
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Lower Bounds and Proximally Anchored SGD for Non-Convex Minimization Under Unbounded Variance
par: Fazla, Arda, et autres
Publié: (2026)

FedSGM: A Unified Framework for Constraint Aware, Bidirectionally Compressed, Multi-Step Federated Optimization
par: Upadhyay, Antesh, et autres
Publié: (2026)

Optimization via First-Order Switching Methods: Skew-Symmetric Dynamics and Optimistic Discretization
par: Upadhyay, Antesh, et autres
Publié: (2025)

RAMPAGE: RAndomized Mid-Point for debiAsed Gradient Extrapolation
par: Luo, Zhankun, et autres
Publié: (2026)

Adaptive Optimization via Momentum on Variance-Normalized Gradients
par: Patitucci, Francisco, et autres
Publié: (2026)

On the Stochastic (Variance-Reduced) Proximal Gradient Method for Regularized Expected Reward Optimization
par: Liang, Ling, et autres
Publié: (2024)

Breaking the Stochasticity Barrier: An Adaptive Variance-Reduced Method for Variational Inequalities
par: Jeong, Yungi, et autres
Publié: (2026)

Unified Convergence Theory of Stochastic and Variance-Reduced Cubic Newton Methods
par: Chayti, El Mahdi, et autres
Publié: (2023)

Adaptive Variance Reduction for Stochastic Optimization under Weaker Assumptions
par: Jiang, Wei, et autres
Publié: (2024)

Unified High-Probability Analysis of Stochastic Variance-Reduced Estimation
par: Luo, Zhankun, et autres
Publié: (2026)

A Variance-Reduced Stochastic Gradient Tracking Algorithm for Decentralized Optimization with Orthogonality Constraints
par: Wang, Lei, et autres
Publié: (2022)

Optimal Asynchronous Stochastic Nonconvex Optimization under Heavy-Tailed Noise
par: Wu, Yidong, et autres
Publié: (2026)

VFOG: Variance-Reduced Fast Optimistic Gradient Methods for a Class of Nonmonotone Generalized Equations
par: Tran-Dinh, Quoc, et autres
Publié: (2025)

Convergence Guarantees for RMSProp and Adam in Generalized-smooth Non-convex Optimization with Affine Noise Variance
par: Zhang, Qi, et autres
Publié: (2024)

Divergence Results and Convergence of a Variance Reduced Version of ADAM
par: Wang, Ruiqi, et autres
Publié: (2022)

Solving Stochastic Variational Inequalities without the Bounded Variance Assumption
par: Alacaoglu, Ahmet, et autres
Publié: (2026)

Variance-Aware Regret Bounds for Stochastic Contextual Dueling Bandits
par: Di, Qiwei, et autres
Publié: (2023)

Infeasible Deterministic, Stochastic, and Variance-Reduction Algorithms for Optimization under Orthogonality Constraints
par: Ablin, Pierre, et autres
Publié: (2023)

Variance-Reduced Cascade Q-learning: Algorithms and Sample Complexity
par: Boveiri, Mohammad, et autres
Publié: (2024)

Towards Weaker Variance Assumptions for Stochastic Optimization
par: Alacaoglu, Ahmet, et autres
Publié: (2025)

Revisiting Gradient Normalization and Clipping for Nonconvex SGD under Heavy-Tailed Noise: Necessity, Sufficiency, and Acceleration
par: Sun, Tao, et autres
Publié: (2024)

Variance-Reduced $(\varepsilon,δ)-$Unlearning using Forget Set Gradients
par: Van Waerebeke, Martin, et autres
Publié: (2026)

Variance Reduction and Low Sample Complexity in Stochastic Optimization via Proximal Point Method
par: Liang, Jiaming
Publié: (2024)

Projection-Free Variance Reduction Methods for Stochastic Constrained Multi-Level Compositional Optimization
par: Jiang, Wei, et autres
Publié: (2024)

Decentralized Non-convex Stochastic Optimization with Heterogeneous Variance
par: Chen, Hongxu, et autres
Publié: (2026)

Truncated Variance Reduced Value Iteration
par: Jin, Yujia, et autres
Publié: (2024)

Stochastic Variance-Reduced Newton: Accelerating Finite-Sum Minimization with Large Batches
par: Dereziński, Michał
Publié: (2022)

TRSVR: An Adaptive Stochastic Trust-Region Method with Variance Reduction
par: Fang, Yuchen, et autres
Publié: (2026)

Nonconvex Stochastic Optimization under Heavy-Tailed Noises: Optimal Convergence without Gradient Clipping
par: Liu, Zijian, et autres
Publié: (2024)

Equitable Federated Learning with Activation Clustering
par: Upadhyay, Antesh, et autres
Publié: (2024)

Policy-based Primal-Dual Methods for Concave CMDP with Variance Reduction
par: Ying, Donghao, et autres
Publié: (2022)

Variance-Reduced Gradient Estimator for Nonconvex Zeroth-Order Distributed Optimization
par: Mu, Huaiyi, et autres
Publié: (2024)

A Finite-Iteration Theory for Asynchronous Categorical Distributional Temporal-Difference Learning
par: Kaya, Ege C., et autres
Publié: (2026)

Efficient Sign-Based Optimization: Accelerating Convergence via Variance Reduction
par: Jiang, Wei, et autres
Publié: (2024)

Optimal Variance-Dependent Regret Bounds for Infinite-Horizon MDPs
par: Zamir, Guy, et autres
Publié: (2026)

On the Convergence of Adaptive Gradient Methods for Nonconvex Optimization
par: Zhou, Dongruo, et autres
Publié: (2018)

Near-Optimal Decentralized Stochastic Nonconvex Optimization with Heavy-Tailed Noise
par: Wang, Menglian, et autres
Publié: (2026)

Drago: Primal-Dual Coupled Variance Reduction for Faster Distributionally Robust Optimization
par: Mehta, Ronak, et autres
Publié: (2024)

Muon is Provably Faster with Momentum Variance Reduction
par: Qian, Xun, et autres
Publié: (2025)

Stochastic Gradient Langevin Dynamics with Variance Reduction
par: Huang, Zhishen, et autres
Publié: (2021)