Copertina

Improved High-Probability Bounds for the Temporal Difference Learning Algorithm via Exponential Stability

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Samsonov, Sergey, Tiapkin, Daniil, Naumov, Alexey, Moulines, Eric
Natura:	Preprint
Pubblicazione:	2023
Soggetti:	Machine Learning Optimization and Control 62L20, 60J20
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Statistical inference for Linear Stochastic Approximation with Markovian Noise
di: Samsonov, Sergey, et al.
Pubblicazione: (2025)

Improved Central Limit Theorem and Bootstrap Approximations for Linear Stochastic Approximation
di: Butyrin, Bogdan, et al.
Pubblicazione: (2025)

Gaussian Approximation and Multiplier Bootstrap for Polyak-Ruppert Averaged Linear Stochastic Approximation with Applications to TD Learning
di: Samsonov, Sergey, et al.
Pubblicazione: (2024)

Nonasymptotic Analysis of Stochastic Gradient Descent with the Richardson-Romberg Extrapolation
di: Sheshukova, Marina, et al.
Pubblicazione: (2024)

High-Order Error Bounds for Markovian LSA with Richardson-Romberg Extrapolation
di: Levin, Ilya, et al.
Pubblicazione: (2025)

Gaussian Approximation for Two-Timescale Linear Stochastic Approximation
di: Butyrin, Bogdan, et al.
Pubblicazione: (2025)

Gaussian Approximation and Multiplier Bootstrap for Stochastic Gradient Descent
di: Sheshukova, Marina, et al.
Pubblicazione: (2025)

A weak convergence approach to large deviations for stochastic approximations
di: Hult, Henrik, et al.
Pubblicazione: (2025)

On the Rate of Gaussian Approximation for Linear Regression Problems
di: Khusainov, Marat, et al.
Pubblicazione: (2025)

A note on concentration inequalities for the overlapped batch mean variance estimators for Markov chains
di: Moulines, Eric, et al.
Pubblicazione: (2025)

Mini-Batch Covariance, Diffusion Limits, and Oracle Complexity in Stochastic Gradient Descent: A Sampling-Design Perspective
di: Zantedeschi, Daniel, et al.
Pubblicazione: (2026)

High Probability Bounds for Stochastic Subgradient Schemes with Heavy Tailed Noise
di: Parletta, Daniela A., et al.
Pubblicazione: (2022)

Stochastic Modified Flows for Riemannian Stochastic Gradient Descent
di: Gess, Benjamin, et al.
Pubblicazione: (2024)

A Short Survey of Averaging Techniques in Stochastic Gradient Methods
di: Lakshmanan, K.
Pubblicazione: (2026)

Global Convergence and Acceleration for Single Observation Gradient Free Optimization
di: Lauand, Caio Kalil, et al.
Pubblicazione: (2025)

When Does Dynamic Preconditioning Preserve the Polyak-Ruppert CLT? A Stabilization Threshold
di: An, Sunyoung, et al.
Pubblicazione: (2026)

An Iterative Bayesian Robbins--Monro Sequence
di: Liu, Siwei, et al.
Pubblicazione: (2025)

Rosenthal-type inequalities for linear statistics of Markov chains
di: Durmus, Alain, et al.
Pubblicazione: (2023)

Stability and Sensitivity Analysis of Relative Temporal-Difference Learning: Extended Version
di: Sakha, Masoud S., et al.
Pubblicazione: (2026)

A Sequential Testing Problem with Signal Control
di: Campbell, Steven, et al.
Pubblicazione: (2025)

Optimal control for production inventory system with various cost criterion
di: Golui, Subrata, et al.
Pubblicazione: (2022)

First is the worst, second is the best? A Markov chain analysis of the basketball game knockout
di: Flatz, Andrew, et al.
Pubblicazione: (2025)

A dynamic view of some anomalous phenomena in SGD
di: Borkar, Vivek Shripad
Pubblicazione: (2025)

Revisiting Stochastic Approximation and Stochastic Gradient Descent
di: Karandikar, Rajeeva Laxman, et al.
Pubblicazione: (2025)

Convergence of Riemannian Stochastic Gradient Descents: Varying Batch Sizes And Nonstandard Batch Forming
di: Wu, Hao
Pubblicazione: (2026)

Optimal control under unknown intensity with Bayesian learning
di: Baradel, Nicolas, et al.
Pubblicazione: (2024)

Optimal resource allocation for maintaining system solvency
di: Guo, Gaoyue, et al.
Pubblicazione: (2026)

A geometric ensemble method for Bayesian inference
di: Popov, Andrey A
Pubblicazione: (2025)

Branch and Bound to Assess Stability of Regression Coefficients in Uncertain Models
di: Knaeble, Brian, et al.
Pubblicazione: (2024)

Asymptotics of generalized Pólya urns with non-linear feedback
di: Gottfried, Thomas, et al.
Pubblicazione: (2023)

Extremely Fast Convergence Rates for Extremum Seeking Control with Polyak-Ruppert Averaging
di: Lauand, Caio Kalil, et al.
Pubblicazione: (2022)

Convergence Rates for Stochastic Approximation: Biased Noise with Unbounded Variance, and Applications
di: Karandikar, Rajeeva L., et al.
Pubblicazione: (2023)

Stochastic Control with Signatures
di: Bank, P., et al.
Pubblicazione: (2024)

Robust Ergodic Control of Jump-Diffusion Systems under Drift and Intensity Uncertainty
di: Azze, Abel, et al.
Pubblicazione: (2026)

Pontryagin Maximum Principle for rough stochastic systems and pathwise stochastic control
di: Horst, Ulrich, et al.
Pubblicazione: (2025)

Outrunning the Omega Clock: A Singular Control Problem for Dividend Optimisation with Ruin and Time-in-Distress Default
di: Bodnariu, Andi, et al.
Pubblicazione: (2026)

Random time-shift approximation enables hierarchical Bayesian inference of mechanistic within-host viral dynamics models on large datasets
di: Morris, Dylan J., et al.
Pubblicazione: (2025)

Online Regularized Learning Algorithms in RKHS with $β$- and $ϕ$-Mixing Sequences
di: Roy, Priyanka, et al.
Pubblicazione: (2025)

Average-reward reinforcement learning in semi-Markov decision processes via relative value iteration
di: Yu, Huizhen, et al.
Pubblicazione: (2025)

Towards Optimal Offline Reinforcement Learning
di: Li, Mengmeng, et al.
Pubblicazione: (2025)