Imagen de Portada

A Short Survey of Averaging Techniques in Stochastic Gradient Methods

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Lakshmanan, K.
Formato:	Preprint
Publicado:	2026
Materias:	Optimization and Control 62L20
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Nonasymptotic Analysis of Stochastic Gradient Descent with the Richardson-Romberg Extrapolation
por: Sheshukova, Marina, et al.
Publicado: (2024)

Global Convergence and Acceleration for Single Observation Gradient Free Optimization
por: Lauand, Caio Kalil, et al.
Publicado: (2025)

An Iterative Bayesian Robbins--Monro Sequence
por: Liu, Siwei, et al.
Publicado: (2025)

Extremely Fast Convergence Rates for Extremum Seeking Control with Polyak-Ruppert Averaging
por: Lauand, Caio Kalil, et al.
Publicado: (2022)

Asynchronous Stochastic Approximation with Applications to Average-Reward Reinforcement Learning
por: Yu, Huizhen, et al.
Publicado: (2024)

Gaussian Approximation and Multiplier Bootstrap for Polyak-Ruppert Averaged Linear Stochastic Approximation with Applications to TD Learning
por: Samsonov, Sergey, et al.
Publicado: (2024)

Revisiting Stochastic Approximation and Stochastic Gradient Descent
por: Karandikar, Rajeeva Laxman, et al.
Publicado: (2025)

A dynamic view of some anomalous phenomena in SGD
por: Borkar, Vivek Shripad
Publicado: (2025)

Statistical inference for Linear Stochastic Approximation with Markovian Noise
por: Samsonov, Sergey, et al.
Publicado: (2025)

High Probability Bounds for Stochastic Subgradient Schemes with Heavy Tailed Noise
por: Parletta, Daniela A., et al.
Publicado: (2022)

Mini-Batch Covariance, Diffusion Limits, and Oracle Complexity in Stochastic Gradient Descent: A Sampling-Design Perspective
por: Zantedeschi, Daniel, et al.
Publicado: (2026)

Average-reward reinforcement learning in semi-Markov decision processes via relative value iteration
por: Yu, Huizhen, et al.
Publicado: (2025)

Improved Central Limit Theorem and Bootstrap Approximations for Linear Stochastic Approximation
por: Butyrin, Bogdan, et al.
Publicado: (2025)

Convergence of Riemannian Stochastic Gradient Descents: Varying Batch Sizes And Nonstandard Batch Forming
por: Wu, Hao
Publicado: (2026)

Optimal control under unknown intensity with Bayesian learning
por: Baradel, Nicolas, et al.
Publicado: (2024)

Unbiased Gradients for a Class of Conditional Stochastic Optimization Problems
por: Alvarez, Miguel, et al.
Publicado: (2026)

Improved High-Probability Bounds for the Temporal Difference Learning Algorithm via Exponential Stability
por: Samsonov, Sergey, et al.
Publicado: (2023)

Partial Identification of the Average Treatment Effect with Stochastic Counterfactuals and Discordant Twins
por: Knaeble, Brian, et al.
Publicado: (2024)

High-Order Error Bounds for Markovian LSA with Richardson-Romberg Extrapolation
por: Levin, Ilya, et al.
Publicado: (2025)

Stochastic Modified Flows for Riemannian Stochastic Gradient Descent
por: Gess, Benjamin, et al.
Publicado: (2024)

Sample Complexity of Policy Gradient for Log-Growth Control
por: Pan, Qiuhua, et al.
Publicado: (2026)

Gaussian Approximation and Multiplier Bootstrap for Stochastic Gradient Descent
por: Sheshukova, Marina, et al.
Publicado: (2025)

BISTRO -- A Bi-Fidelity Stochastic Gradient Framework using Trust-Regions for Optimization Under Uncertainty
por: Dixon, Thomas O., et al.
Publicado: (2025)

Gaussian Approximation for Two-Timescale Linear Stochastic Approximation
por: Butyrin, Bogdan, et al.
Publicado: (2025)

Multi-Iteration Stochastic Optimizers
por: Carlon, Andre, et al.
Publicado: (2020)

Adaptive Stochastic Gradient Descents on Manifolds with an Application on Weighted Low-Rank Approximation
por: Yang, Peiqi, et al.
Publicado: (2025)

A Sequential Testing Problem with Signal Control
por: Campbell, Steven, et al.
Publicado: (2025)

Convergence Rates for Stochastic Approximation: Biased Noise with Unbounded Variance, and Applications
por: Karandikar, Rajeeva L., et al.
Publicado: (2023)

When Does Dynamic Preconditioning Preserve the Polyak-Ruppert CLT? A Stabilization Threshold
por: An, Sunyoung, et al.
Publicado: (2026)

A weak convergence approach to large deviations for stochastic approximations
por: Hult, Henrik, et al.
Publicado: (2025)

A Note on Stability in Asynchronous Stochastic Approximation without Communication Delays
por: Yu, Huizhen, et al.
Publicado: (2023)

Stochastic Approximation for Nonlinear Discrete Stochastic Control: Finite-Sample Bounds
por: Nguyen, Hoang Huy, et al.
Publicado: (2023)

A geometric ensemble method for Bayesian inference
por: Popov, Andrey A
Publicado: (2025)

IPAS: An Adaptive Sample Size Method for Weighted Finite Sum Problems with Linear Equality Constraints
por: Krejić, Nataša, et al.
Publicado: (2025)

Signature Methods in Stochastic Portfolio Theory
por: Cuchiero, Christa, et al.
Publicado: (2023)

Optimal Asymptotic Rates for (Stochastic) Gradient Descent under the Local PL-Condition: A Geometric Approach
por: Kassing, Sebastian, et al.
Publicado: (2026)

Stability and Sensitivity Analysis of Relative Temporal-Difference Learning: Extended Version
por: Sakha, Masoud S., et al.
Publicado: (2026)

Optimistic Training and Convergence of Q-Learning -- Extended Version
por: Mehta, Prashant, et al.
Publicado: (2026)

On the Rate of Gaussian Approximation for Linear Regression Problems
por: Khusainov, Marat, et al.
Publicado: (2025)

Robust Nonparametric Stochastic Frontier Analysis
por: Zheng, Peng, et al.
Publicado: (2024)