Copertina

Tight Finite Time Bounds of Two-Time-Scale Linear Stochastic Approximation with Markovian Noise

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Haque, Shaan Ul, Khodadadian, Sajad, Maguluri, Siva Theja
Natura:	Preprint
Pubblicazione:	2023
Soggetti:	Machine Learning Systems and Control Optimization and Control
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Stochastic Approximation with Unbounded Markovian Noise: A General-Purpose Theorem
di: Haque, Shaan Ul, et al.
Pubblicazione: (2024)

Finite-Time Bounds for Two-Time-Scale Stochastic Approximation with Arbitrary Norm Contractions and Markovian Noise
di: Chandak, Siddharth, et al.
Pubblicazione: (2025)

Concentration of General Stochastic Approximation Under Heavy-Tailed Markovian Noise
di: Agrawal, Shubhada, et al.
Pubblicazione: (2026)

A Non-Asymptotic Theory of Seminorm Lyapunov Stability: From Deterministic to Stochastic Iterative Algorithms
di: Chen, Zaiwei, et al.
Pubblicazione: (2025)

Concentration of Contractive Stochastic Approximation: Additive and Multiplicative Noise
di: Chen, Zaiwei, et al.
Pubblicazione: (2023)

$O(1/k)$ Finite-Time Bound for Non-Linear Two-Time-Scale Stochastic Approximation
di: Chandak, Siddharth
Pubblicazione: (2025)

Heavy-Tailed and Long-Range Dependent Noise in Stochastic Approximation: A Finite-Time Analysis
di: Chandak, Siddharth, et al.
Pubblicazione: (2026)

Stochastic Approximation with Delayed Updates: Finite-Time Rates under Markovian Sampling
di: Adibi, Arman, et al.
Pubblicazione: (2024)

Achieving Tighter Finite-Time Rates for Heterogeneous Federated Stochastic Approximation under Markovian Sampling
di: Zhu, Feng, et al.
Pubblicazione: (2025)

Performance of NPG in Countable State-Space Average-Cost RL
di: Murthy, Yashaswini, et al.
Pubblicazione: (2024)

Stochastic Approximation for Nonlinear Discrete Stochastic Control: Finite-Sample Bounds
di: Nguyen, Hoang Huy, et al.
Pubblicazione: (2023)

A Simple Finite-Time Analysis of TD Learning with Linear Function Approximation
di: Mitra, Aritra
Pubblicazione: (2024)

Tail Distribution of Regret in Optimistic Reinforcement Learning
di: Khodadadian, Sajad, et al.
Pubblicazione: (2025)

Finite-Time Decoupled Convergence in Nonlinear Two-Time-Scale Stochastic Approximation
di: Han, Yuze, et al.
Pubblicazione: (2024)

Adversarially-Robust TD Learning with Markovian Data: Finite-Time Rates and Fundamental Limits
di: Maity, Sreejeet, et al.
Pubblicazione: (2025)

High-Probability Bounds for SGD under the Polyak-Lojasiewicz Condition with Markovian Noise
di: Kar, Avik, et al.
Pubblicazione: (2026)

Federated Stochastic Approximation under Markov Noise and Heterogeneity: Applications in Reinforcement Learning
di: Khodadadian, Sajad, et al.
Pubblicazione: (2022)

Two-Timescale Linear Stochastic Approximation: Constant Stepsizes Go a Long Way
di: Kwon, Jeongyeol, et al.
Pubblicazione: (2024)

Almost Sure Convergence of Stochastic Approximation: An Interplay of Noise and Step Size
di: Nguyen, Quang Dinh Thien, et al.
Pubblicazione: (2026)

Central Limit Theorem for Two-Timescale Stochastic Approximation with Markovian Noise: Theory and Applications
di: Hu, Jie, et al.
Pubblicazione: (2024)

Asymptotic and Finite Sample Analysis of Nonexpansive Stochastic Approximations with Markovian Noise
di: Blaser, Ethan, et al.
Pubblicazione: (2024)

How Accurately Can a Gaussian Approximate Stochastic Approximation Iterates?
di: Haque, Shaan Ul, et al.
Pubblicazione: (2026)

Computing the Bias of Constant-step Stochastic Approximation with Markovian Noise
di: Allmeier, Sebastian, et al.
Pubblicazione: (2024)

Fast Nonlinear Two-Time-Scale Stochastic Approximation: Achieving $O(1/k)$ Finite-Sample Complexity
di: Doan, Thinh T.
Pubblicazione: (2024)

Convergence Rate in Nonlinear Two-Time-Scale Stochastic Approximation with State (Time)-Dependence
di: Chen, Zixi, et al.
Pubblicazione: (2025)

Predictor-Based Output-Feedback Control of Linear Systems with Time-Varying Input and Measurement Delays via Neural-Approximated Prediction Horizons
di: Bhan, Luke, et al.
Pubblicazione: (2026)

Finite-Time Analysis of On-Policy Heterogeneous Federated Reinforcement Learning
di: Zhang, Chenyu, et al.
Pubblicazione: (2024)

Bias and Extrapolation in Markovian Linear Stochastic Approximation with Constant Stepsizes
di: Huo, Dongyan, et al.
Pubblicazione: (2022)

Learning to Sparsify Stochastic Linear Bandits
di: Wang, Zhengmiao, et al.
Pubblicazione: (2026)

Mutual Information Optimal Control of Discrete-Time Linear Systems
di: Enami, Shoju, et al.
Pubblicazione: (2025)

Online Control of Linear Systems under Unbounded Noise
di: Ito, Kaito, et al.
Pubblicazione: (2024)

Electric Vehicle Fleet and Charging Infrastructure Planning
di: Varma, Sushil Mahavir, et al.
Pubblicazione: (2023)

Almost Sure Convergence Rates and Concentration of Stochastic Approximation and Reinforcement Learning with Markovian Noise
di: Qian, Xiaochi, et al.
Pubblicazione: (2024)

Outlier-Robust Linear System Identification Under Heavy-tailed Noise
di: Kanakeri, Vinay, et al.
Pubblicazione: (2024)

CLT-Optimal Parameter Error Bounds for Linear System Identification
di: Zhou, Yichen, et al.
Pubblicazione: (2026)

On Policy Stochasticity in Mutual Information Optimal Control of Linear Systems
di: Enami, Shoju, et al.
Pubblicazione: (2025)

Dynamic Pricing and Matching for Two-Sided Queues
di: Varma, Sushil Mahavir, et al.
Pubblicazione: (2019)

Non-Asymptotic Bounds for Closed-Loop Identification of Unstable Nonlinear Stochastic Systems
di: Siriya, Seth, et al.
Pubblicazione: (2024)

Fixed Horizon Linear Quadratic Covariance Steering in Continuous Time with Hilbert-Schmidt Terminal Cost
di: Sial, Tushar, et al.
Pubblicazione: (2025)

Certified Approximate Reachability (CARe): Formal Error Bounds on Deep Learning of Reachable Sets
di: Solanki, Prashant, et al.
Pubblicazione: (2025)