Copertina

Stochastic Gradient Langevin Dynamics with Variance Reduction

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Huang, Zhishen, Becker, Stephen
Natura:	Preprint
Pubblicazione:	2021
Soggetti:	Machine Learning Optimization and Control
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Gradient Estimation and Variance Reduction in Stochastic and Deterministic Models
di: Keane, Ronan
Pubblicazione: (2024)

Flatness-Aware Stochastic Gradient Langevin Dynamics
di: Bruno, Stefano, et al.
Pubblicazione: (2025)

Convergence of Stochastic Gradient Langevin Dynamics in the Lazy Training Regime
di: Oberweis, Noah, et al.
Pubblicazione: (2025)

TRSVR: An Adaptive Stochastic Trust-Region Method with Variance Reduction
di: Fang, Yuchen, et al.
Pubblicazione: (2026)

Adaptive Variance Reduction for Stochastic Optimization under Weaker Assumptions
di: Jiang, Wei, et al.
Pubblicazione: (2024)

Towards Weaker Variance Assumptions for Stochastic Optimization
di: Alacaoglu, Ahmet, et al.
Pubblicazione: (2025)

Projected Forward Gradient-Guided Frank-Wolfe Algorithm via Variance Reduction
di: Rostami, M., et al.
Pubblicazione: (2024)

Global Convergence of Natural Policy Gradient with Hessian-aided Momentum Variance Reduction
di: Feng, Jie, et al.
Pubblicazione: (2024)

On the Stochastic (Variance-Reduced) Proximal Gradient Method for Regularized Expected Reward Optimization
di: Liang, Ling, et al.
Pubblicazione: (2024)

Infeasible Deterministic, Stochastic, and Variance-Reduction Algorithms for Optimization under Orthogonality Constraints
di: Ablin, Pierre, et al.
Pubblicazione: (2023)

Variance Reduction and Low Sample Complexity in Stochastic Optimization via Proximal Point Method
di: Liang, Jiaming
Pubblicazione: (2024)

Projection-Free Variance Reduction Methods for Stochastic Constrained Multi-Level Compositional Optimization
di: Jiang, Wei, et al.
Pubblicazione: (2024)

A Variance-Reduced Stochastic Gradient Tracking Algorithm for Decentralized Optimization with Orthogonality Constraints
di: Wang, Lei, et al.
Pubblicazione: (2022)

Variance Reduction Methods Do Not Need to Compute Full Gradients: Improved Efficiency through Shuffling
di: Medyakov, Daniil, et al.
Pubblicazione: (2025)

Double Variance Reduction: A Smoothing Trick for Composite Optimization Problems without First-Order Gradient
di: Di, Hao, et al.
Pubblicazione: (2024)

Stochastic Subspace Descent Accelerated via Bi-fidelity Line Search
di: Cheng, Nuojin, et al.
Pubblicazione: (2025)

Muon is Provably Faster with Momentum Variance Reduction
di: Qian, Xun, et al.
Pubblicazione: (2025)

Adaptive Optimization via Momentum on Variance-Normalized Gradients
di: Patitucci, Francisco, et al.
Pubblicazione: (2026)

Mirror Mean-Field Langevin Dynamics
di: Gu, Anming, et al.
Pubblicazione: (2025)

MARS-M: When Variance Reduction Meets Matrices
di: Liu, Yifeng, et al.
Pubblicazione: (2025)

Decentralized Non-convex Stochastic Optimization with Heterogeneous Variance
di: Chen, Hongxu, et al.
Pubblicazione: (2026)

MARS: Unleashing the Power of Variance Reduction for Training Large Models
di: Yuan, Huizhuo, et al.
Pubblicazione: (2024)

Variance-Aware Regret Bounds for Stochastic Contextual Dueling Bandits
di: Di, Qiwei, et al.
Pubblicazione: (2023)

Solving Stochastic Variational Inequalities without the Bounded Variance Assumption
di: Alacaoglu, Ahmet, et al.
Pubblicazione: (2026)

Convergence Error Analysis of Reflected Gradient Langevin Dynamics for Globally Optimizing Non-Convex Constrained Problems
di: Sato, Kanji, et al.
Pubblicazione: (2022)

Variance-Reduced $(\varepsilon,δ)-$Unlearning using Forget Set Gradients
di: Van Waerebeke, Martin, et al.
Pubblicazione: (2026)

Efficient Sign-Based Optimization: Accelerating Convergence via Variance Reduction
di: Jiang, Wei, et al.
Pubblicazione: (2024)

VAMO: Efficient Zeroth-Order Variance Reduction for SGD with Faster Convergence
di: Chen, Jiahe, et al.
Pubblicazione: (2025)

Policy-based Primal-Dual Methods for Concave CMDP with Variance Reduction
di: Ying, Donghao, et al.
Pubblicazione: (2022)

Unified Convergence Theory of Stochastic and Variance-Reduced Cubic Newton Methods
di: Chayti, El Mahdi, et al.
Pubblicazione: (2023)

Breaking the Stochasticity Barrier: An Adaptive Variance-Reduced Method for Variational Inequalities
di: Jeong, Yungi, et al.
Pubblicazione: (2026)

Stochastic Gradients under Nuisances
di: Yu, Facheng, et al.
Pubblicazione: (2025)

Drago: Primal-Dual Coupled Variance Reduction for Faster Distributionally Robust Optimization
di: Mehta, Ronak, et al.
Pubblicazione: (2024)

Stochastic Variance-Reduced Newton: Accelerating Finite-Sum Minimization with Large Batches
di: Dereziński, Michał
Pubblicazione: (2022)

Symmetric Mean-field Langevin Dynamics for Distributional Minimax Problems
di: Kim, Juno, et al.
Pubblicazione: (2023)

Momentum Does Not Reduce Stochastic Noise in Stochastic Gradient Descent
di: Sato, Naoki, et al.
Pubblicazione: (2024)

Stochastic Gradient Methods with Preconditioned Updates
di: Sadiev, Abdurakhmon, et al.
Pubblicazione: (2022)

Stochastic Gradient Descent with Adaptive Data
di: Che, Ethan, et al.
Pubblicazione: (2024)

Stochastic Gradient Descent with Strategic Querying
di: Jiang, Nanfei, et al.
Pubblicazione: (2025)

Demystifying SGD with Doubly Stochastic Gradients
di: Kim, Kyurae, et al.
Pubblicazione: (2024)