Imagen de Portada

Divergence Results and Convergence of a Variance Reduced Version of ADAM

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Wang, Ruiqi, Klabjan, Diego
Formato:	Preprint
Publicado:	2022
Materias:	Machine Learning Optimization and Control
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

A Mirror Descent Perspective of Smoothed Sign Descent
por: Wang, Shuyang, et al.
Publicado: (2024)

Unified Convergence Theory of Stochastic and Variance-Reduced Cubic Newton Methods
por: Chayti, El Mahdi, et al.
Publicado: (2023)

Continuous-Time Analysis of Federated Averaging
por: Overman, Tom, et al.
Publicado: (2025)

Beyond Bounded Variance: Variance-Reduced Normalized Methods for Nonconvex Optimization under Blum-Gladyshev Noise
por: Upadhyay, Antesh, et al.
Publicado: (2026)

Efficient Sign-Based Optimization: Accelerating Convergence via Variance Reduction
por: Jiang, Wei, et al.
Publicado: (2024)

VAMO: Efficient Zeroth-Order Variance Reduction for SGD with Faster Convergence
por: Chen, Jiahe, et al.
Publicado: (2025)

A Variance-Reduced Stochastic Gradient Tracking Algorithm for Decentralized Optimization with Orthogonality Constraints
por: Wang, Lei, et al.
Publicado: (2022)

Convergence Properties of Natural Gradient Descent for Minimizing KL Divergence
por: Datar, Adwait, et al.
Publicado: (2025)

Variance-Reduced Cascade Q-learning: Algorithms and Sample Complexity
por: Boveiri, Mohammad, et al.
Publicado: (2024)

Global Convergence of Natural Policy Gradient with Hessian-aided Momentum Variance Reduction
por: Feng, Jie, et al.
Publicado: (2024)

Variance-Reduced $(\varepsilon,δ)-$Unlearning using Forget Set Gradients
por: Van Waerebeke, Martin, et al.
Publicado: (2026)

Breaking the Stochasticity Barrier: An Adaptive Variance-Reduced Method for Variational Inequalities
por: Jeong, Yungi, et al.
Publicado: (2026)

Dimension-Independent Convergence of Underdamped Langevin Monte Carlo in KL Divergence
por: Zhang, Shiyuan, et al.
Publicado: (2026)

Stochastic Variance-Reduced Newton: Accelerating Finite-Sum Minimization with Large Batches
por: Dereziński, Michał
Publicado: (2022)

On the Stochastic (Variance-Reduced) Proximal Gradient Method for Regularized Expected Reward Optimization
por: Liang, Ling, et al.
Publicado: (2024)

Memory-Reduced Meta-Learning with Guaranteed Convergence
por: Yang, Honglin, et al.
Publicado: (2024)

VFOG: Variance-Reduced Fast Optimistic Gradient Methods for a Class of Nonmonotone Generalized Equations
por: Tran-Dinh, Quoc, et al.
Publicado: (2025)

Truncated Variance Reduced Value Iteration
por: Jin, Yujia, et al.
Publicado: (2024)

Convergence Guarantees for RMSProp and Adam in Generalized-smooth Non-convex Optimization with Affine Noise Variance
por: Zhang, Qi, et al.
Publicado: (2024)

A Generalization Result for Convergence in Learning-to-Optimize
por: Sucker, Michael, et al.
Publicado: (2024)

Sample Complexity of Variance-reduced Distributionally Robust Q-learning
por: Wang, Shengbo, et al.
Publicado: (2023)

Adaptive Variance Reduction for Stochastic Optimization under Weaker Assumptions
por: Jiang, Wei, et al.
Publicado: (2024)

Muon is Provably Faster with Momentum Variance Reduction
por: Qian, Xun, et al.
Publicado: (2025)

Stochastic Gradient Langevin Dynamics with Variance Reduction
por: Huang, Zhishen, et al.
Publicado: (2021)

Towards Weaker Variance Assumptions for Stochastic Optimization
por: Alacaoglu, Ahmet, et al.
Publicado: (2025)

Decentralized Non-convex Stochastic Optimization with Heterogeneous Variance
por: Chen, Hongxu, et al.
Publicado: (2026)

Variance reduction techniques for stochastic proximal point algorithms
por: Traoré, Cheik, et al.
Publicado: (2023)

Adaptive Optimization via Momentum on Variance-Normalized Gradients
por: Patitucci, Francisco, et al.
Publicado: (2026)

MARS-M: When Variance Reduction Meets Matrices
por: Liu, Yifeng, et al.
Publicado: (2025)

Reusing Historical Trajectories in Natural Policy Gradient via Importance Sampling: Convergence and Convergence Rate
por: Lin, Yifan, et al.
Publicado: (2024)

Gradient Estimation and Variance Reduction in Stochastic and Deterministic Models
por: Keane, Ronan
Publicado: (2024)

Projection-Free Variance Reduction Methods for Stochastic Constrained Multi-Level Compositional Optimization
por: Jiang, Wei, et al.
Publicado: (2024)

Variance-Aware Feel-Good Thompson Sampling for Contextual Bandits
por: Li, Xuheng, et al.
Publicado: (2025)

Variance-Aware Regret Bounds for Stochastic Contextual Dueling Bandits
por: Di, Qiwei, et al.
Publicado: (2023)

TRSVR: An Adaptive Stochastic Trust-Region Method with Variance Reduction
por: Fang, Yuchen, et al.
Publicado: (2026)

MARS: Unleashing the Power of Variance Reduction for Training Large Models
por: Yuan, Huizhuo, et al.
Publicado: (2024)

Solving Stochastic Variational Inequalities without the Bounded Variance Assumption
por: Alacaoglu, Ahmet, et al.
Publicado: (2026)

Online Nonconvex Bilevel Optimization with Bregman Divergences
por: Bohne, Jason, et al.
Publicado: (2024)

Improving Generalization and Convergence by Enhancing Implicit Regularization
por: Wang, Mingze, et al.
Publicado: (2024)

Policy-based Primal-Dual Methods for Concave CMDP with Variance Reduction
por: Ying, Donghao, et al.
Publicado: (2022)