Copertina

A Short Survey of Averaging Techniques in Stochastic Gradient Methods

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autore principale:	Lakshmanan, K.
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Optimization and Control 62L20
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Nonasymptotic Analysis of Stochastic Gradient Descent with the Richardson-Romberg Extrapolation
di: Sheshukova, Marina, et al.
Pubblicazione: (2024)

Global Convergence and Acceleration for Single Observation Gradient Free Optimization
di: Lauand, Caio Kalil, et al.
Pubblicazione: (2025)

An Iterative Bayesian Robbins--Monro Sequence
di: Liu, Siwei, et al.
Pubblicazione: (2025)

Extremely Fast Convergence Rates for Extremum Seeking Control with Polyak-Ruppert Averaging
di: Lauand, Caio Kalil, et al.
Pubblicazione: (2022)

Asynchronous Stochastic Approximation with Applications to Average-Reward Reinforcement Learning
di: Yu, Huizhen, et al.
Pubblicazione: (2024)

Gaussian Approximation and Multiplier Bootstrap for Polyak-Ruppert Averaged Linear Stochastic Approximation with Applications to TD Learning
di: Samsonov, Sergey, et al.
Pubblicazione: (2024)

Revisiting Stochastic Approximation and Stochastic Gradient Descent
di: Karandikar, Rajeeva Laxman, et al.
Pubblicazione: (2025)

A dynamic view of some anomalous phenomena in SGD
di: Borkar, Vivek Shripad
Pubblicazione: (2025)

Statistical inference for Linear Stochastic Approximation with Markovian Noise
di: Samsonov, Sergey, et al.
Pubblicazione: (2025)

High Probability Bounds for Stochastic Subgradient Schemes with Heavy Tailed Noise
di: Parletta, Daniela A., et al.
Pubblicazione: (2022)

Mini-Batch Covariance, Diffusion Limits, and Oracle Complexity in Stochastic Gradient Descent: A Sampling-Design Perspective
di: Zantedeschi, Daniel, et al.
Pubblicazione: (2026)

Average-reward reinforcement learning in semi-Markov decision processes via relative value iteration
di: Yu, Huizhen, et al.
Pubblicazione: (2025)

Improved Central Limit Theorem and Bootstrap Approximations for Linear Stochastic Approximation
di: Butyrin, Bogdan, et al.
Pubblicazione: (2025)

Convergence of Riemannian Stochastic Gradient Descents: Varying Batch Sizes And Nonstandard Batch Forming
di: Wu, Hao
Pubblicazione: (2026)

Optimal control under unknown intensity with Bayesian learning
di: Baradel, Nicolas, et al.
Pubblicazione: (2024)

Unbiased Gradients for a Class of Conditional Stochastic Optimization Problems
di: Alvarez, Miguel, et al.
Pubblicazione: (2026)

Improved High-Probability Bounds for the Temporal Difference Learning Algorithm via Exponential Stability
di: Samsonov, Sergey, et al.
Pubblicazione: (2023)

Partial Identification of the Average Treatment Effect with Stochastic Counterfactuals and Discordant Twins
di: Knaeble, Brian, et al.
Pubblicazione: (2024)

High-Order Error Bounds for Markovian LSA with Richardson-Romberg Extrapolation
di: Levin, Ilya, et al.
Pubblicazione: (2025)

Stochastic Modified Flows for Riemannian Stochastic Gradient Descent
di: Gess, Benjamin, et al.
Pubblicazione: (2024)

Sample Complexity of Policy Gradient for Log-Growth Control
di: Pan, Qiuhua, et al.
Pubblicazione: (2026)

Gaussian Approximation and Multiplier Bootstrap for Stochastic Gradient Descent
di: Sheshukova, Marina, et al.
Pubblicazione: (2025)

BISTRO -- A Bi-Fidelity Stochastic Gradient Framework using Trust-Regions for Optimization Under Uncertainty
di: Dixon, Thomas O., et al.
Pubblicazione: (2025)

Gaussian Approximation for Two-Timescale Linear Stochastic Approximation
di: Butyrin, Bogdan, et al.
Pubblicazione: (2025)

Multi-Iteration Stochastic Optimizers
di: Carlon, Andre, et al.
Pubblicazione: (2020)

Adaptive Stochastic Gradient Descents on Manifolds with an Application on Weighted Low-Rank Approximation
di: Yang, Peiqi, et al.
Pubblicazione: (2025)

A Sequential Testing Problem with Signal Control
di: Campbell, Steven, et al.
Pubblicazione: (2025)

Convergence Rates for Stochastic Approximation: Biased Noise with Unbounded Variance, and Applications
di: Karandikar, Rajeeva L., et al.
Pubblicazione: (2023)

When Does Dynamic Preconditioning Preserve the Polyak-Ruppert CLT? A Stabilization Threshold
di: An, Sunyoung, et al.
Pubblicazione: (2026)

A weak convergence approach to large deviations for stochastic approximations
di: Hult, Henrik, et al.
Pubblicazione: (2025)

A Note on Stability in Asynchronous Stochastic Approximation without Communication Delays
di: Yu, Huizhen, et al.
Pubblicazione: (2023)

Stochastic Approximation for Nonlinear Discrete Stochastic Control: Finite-Sample Bounds
di: Nguyen, Hoang Huy, et al.
Pubblicazione: (2023)

A geometric ensemble method for Bayesian inference
di: Popov, Andrey A
Pubblicazione: (2025)

IPAS: An Adaptive Sample Size Method for Weighted Finite Sum Problems with Linear Equality Constraints
di: Krejić, Nataša, et al.
Pubblicazione: (2025)

Signature Methods in Stochastic Portfolio Theory
di: Cuchiero, Christa, et al.
Pubblicazione: (2023)

Optimal Asymptotic Rates for (Stochastic) Gradient Descent under the Local PL-Condition: A Geometric Approach
di: Kassing, Sebastian, et al.
Pubblicazione: (2026)

Stability and Sensitivity Analysis of Relative Temporal-Difference Learning: Extended Version
di: Sakha, Masoud S., et al.
Pubblicazione: (2026)

Optimistic Training and Convergence of Q-Learning -- Extended Version
di: Mehta, Prashant, et al.
Pubblicazione: (2026)

On the Rate of Gaussian Approximation for Linear Regression Problems
di: Khusainov, Marat, et al.
Pubblicazione: (2025)

Robust Nonparametric Stochastic Frontier Analysis
di: Zheng, Peng, et al.
Pubblicazione: (2024)