Copertina

Almost Sure Convergence Rates and Concentration of Stochastic Approximation and Reinforcement Learning with Markovian Noise

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Qian, Xiaochi, Xie, Zixuan, Liu, Xinyu, Zhang, Shangtong
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Optimization and Control
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Almost Sure Convergence Rates of Stochastic Approximation and Reinforcement Learning via a Poisson-Moreau Drift
di: Liu, Xinyu, et al.
Pubblicazione: (2026)

Extensions of Robbins-Siegmund Theorem with Applications in Reinforcement Learning
di: Liu, Xinyu, et al.
Pubblicazione: (2025)

Asymptotic and Finite Sample Analysis of Nonexpansive Stochastic Approximations with Markovian Noise
di: Blaser, Ethan, et al.
Pubblicazione: (2024)

Almost Sure Convergence Analysis of Differentially Private Stochastic Gradient Methods
di: Mukherjee, Amartya, et al.
Pubblicazione: (2025)

Almost Sure Convergence of Stochastic Approximation: An Interplay of Noise and Step Size
di: Nguyen, Quang Dinh Thien, et al.
Pubblicazione: (2026)

Concentration of General Stochastic Approximation Under Heavy-Tailed Markovian Noise
di: Agrawal, Shubhada, et al.
Pubblicazione: (2026)

Computing the Bias of Constant-step Stochastic Approximation with Markovian Noise
di: Allmeier, Sebastian, et al.
Pubblicazione: (2024)

Generalized Smooth Stochastic Variational Inequalities: Almost Sure Convergence and Convergence Rates
di: Vankov, Daniil, et al.
Pubblicazione: (2024)

Stochastic Approximation with Unbounded Markovian Noise: A General-Purpose Theorem
di: Haque, Shaan Ul, et al.
Pubblicazione: (2024)

Concentration of Contractive Stochastic Approximation: Additive and Multiplicative Noise
di: Chen, Zaiwei, et al.
Pubblicazione: (2023)

Almost Surely $\sqrt{T}$ Regret for Adaptive LQR
di: Lu, Yiwen, et al.
Pubblicazione: (2023)

Bias and Extrapolation in Markovian Linear Stochastic Approximation with Constant Stepsizes
di: Huo, Dongyan, et al.
Pubblicazione: (2022)

Central Limit Theorem for Two-Timescale Stochastic Approximation with Markovian Noise: Theory and Applications
di: Hu, Jie, et al.
Pubblicazione: (2024)

Tight Finite Time Bounds of Two-Time-Scale Linear Stochastic Approximation with Markovian Noise
di: Haque, Shaan Ul, et al.
Pubblicazione: (2023)

Almost Sure Convergence and Non-asymptotic Concentration Bounds for Stochastic Mirror Descent Algorithm
di: Paul, Anik Kumar, et al.
Pubblicazione: (2024)

On the Almost Sure Convergence of the Stochastic Three Points Algorithm
di: Kadi, Taha El Bakkali El, et al.
Pubblicazione: (2025)

Convergence Rate in Nonlinear Two-Time-Scale Stochastic Approximation with State (Time)-Dependence
di: Chen, Zixi, et al.
Pubblicazione: (2025)

Finite-Time Bounds for Two-Time-Scale Stochastic Approximation with Arbitrary Norm Contractions and Markovian Noise
di: Chandak, Siddharth, et al.
Pubblicazione: (2025)

Exponential Concentration in Stochastic Approximation
di: Law, Kody, et al.
Pubblicazione: (2022)

In-Expectation Convergence of Stochastic Gradient Methods under Heavy-Tailed Noise
di: Liu, Zijian
Pubblicazione: (2026)

Accelerated Convergence of Stochastic Heavy Ball Method under Anisotropic Gradient Noise
di: Pan, Rui, et al.
Pubblicazione: (2023)

Adaptive Algorithms with Sharp Convergence Rates for Stochastic Hierarchical Optimization
di: Gong, Xiaochuan, et al.
Pubblicazione: (2025)

Achieving Tighter Finite-Time Rates for Heterogeneous Federated Stochastic Approximation under Markovian Sampling
di: Zhu, Feng, et al.
Pubblicazione: (2025)

Stochastic Approximation with Delayed Updates: Finite-Time Rates under Markovian Sampling
di: Adibi, Arman, et al.
Pubblicazione: (2024)

Nonsmooth Implicit Differentiation: Deterministic and Stochastic Convergence Rates
di: Grazzi, Riccardo, et al.
Pubblicazione: (2024)

Convergence Rate of the Last Iterate of Stochastic Proximal Algorithms
di: Vaidyan, Kevin Kurian Thomas, et al.
Pubblicazione: (2026)

The ODE Method for Stochastic Approximation and Reinforcement Learning with Markovian Noise
di: Liu, Shuze Daniel, et al.
Pubblicazione: (2024)

Finite-Time Decoupled Convergence in Nonlinear Two-Time-Scale Stochastic Approximation
di: Han, Yuze, et al.
Pubblicazione: (2024)

Nonconvex Stochastic Optimization under Heavy-Tailed Noises: Optimal Convergence without Gradient Clipping
di: Liu, Zijian, et al.
Pubblicazione: (2024)

Non-Parametric Learning of Stochastic Differential Equations with Non-asymptotic Fast Rates of Convergence
di: Bonalli, Riccardo, et al.
Pubblicazione: (2023)

Stochastic-Constrained Stochastic Optimization with Markovian Data
di: Kim, Yeongjong, et al.
Pubblicazione: (2023)

Theoretical Analysis on how Learning Rate Warmup Accelerates Convergence
di: Liu, Yuxing, et al.
Pubblicazione: (2025)

Improved Learning Rates for Stochastic Optimization
di: Li, Shaojie, et al.
Pubblicazione: (2021)

Almost Sure Convergence of Linear Temporal Difference Learning with Arbitrary Features
di: Wang, Jiuqi, et al.
Pubblicazione: (2024)

Convergence of Two-Timescale Markovian Stochastic Approximations with Applications in Reinforcement Learning
di: Mahadevan, Vagul, et al.
Pubblicazione: (2026)

High-Probability Convergence for Composite and Distributed Stochastic Minimization and Variational Inequalities with Heavy-Tailed Noise
di: Gorbunov, Eduard, et al.
Pubblicazione: (2023)

Coupling-based Convergence Diagnostic and Stepsize Scheme for Stochastic Gradient Descent
di: Li, Xiang, et al.
Pubblicazione: (2024)

Convergence Rates for Stochastic Approximation: Biased Noise with Unbounded Variance, and Applications
di: Karandikar, Rajeeva L., et al.
Pubblicazione: (2023)

Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set
di: Liu, Xinyu, et al.
Pubblicazione: (2025)

Regret Analysis with Almost Sure Convergence for OBF-ARX Filter
di: Li, Jiayun, et al.
Pubblicazione: (2024)