Imagen de Portada

A Concentration Bound for TD(0) with Function Approximation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Chandak, Siddharth, Borkar, Vivek S.
Formato:	Preprint
Publicado:	2023
Materias:	Machine Learning Systems and Control
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

$O(1/k)$ Finite-Time Bound for Non-Linear Two-Time-Scale Stochastic Approximation
por: Chandak, Siddharth
Publicado: (2025)

Reinforcement Learning in Non-Markovian Environments
por: Chandak, Siddharth, et al.
Publicado: (2022)

Finite-Time Bounds for Two-Time-Scale Stochastic Approximation with Arbitrary Norm Contractions and Markovian Noise
por: Chandak, Siddharth, et al.
Publicado: (2025)

Heavy-Tailed and Long-Range Dependent Noise in Stochastic Approximation: A Finite-Time Analysis
por: Chandak, Siddharth, et al.
Publicado: (2026)

Learning to Control Unknown Strongly Monotone Games
por: Chandak, Siddharth, et al.
Publicado: (2024)

High-Probability Bounds for SGD under the Polyak-Lojasiewicz Condition with Markovian Noise
por: Kar, Avik, et al.
Publicado: (2026)

A Simple Finite-Time Analysis of TD Learning with Linear Function Approximation
por: Mitra, Aritra
Publicado: (2024)

Regret and Sample Complexity of Online Q-Learning via Concentration of Stochastic Approximation with Time-Inhomogeneous Markov Chains
por: Singh, Rahul, et al.
Publicado: (2026)

Non-Expansive Mappings in Two-Time-Scale Stochastic Approximation: Finite-Time Analysis
por: Chandak, Siddharth
Publicado: (2025)

Analysis of Off-Policy Multi-Step TD-Learning with Linear Function Approximation
por: Lee, Donghwan
Publicado: (2024)

Last-Iterate Guarantees for Learning in Co-coercive Games
por: Chandak, Siddharth, et al.
Publicado: (2026)

Choose Your Battles: Distributed Learning Over Multiple Tug of War Games
por: Chandak, Siddharth, et al.
Publicado: (2025)

Function Gradient Approximation with Random Shallow ReLU Networks with Control Applications
por: Lamperski, Andrew, et al.
Publicado: (2024)

A dynamic view of some anomalous phenomena in SGD
por: Borkar, Vivek Shripad
Publicado: (2025)

Adversarially-Robust TD Learning with Markovian Data: Finite-Time Rates and Fundamental Limits
por: Maity, Sreejeet, et al.
Publicado: (2025)

Certified Approximate Reachability (CARe): Formal Error Bounds on Deep Learning of Reachable Sets
por: Solanki, Prashant, et al.
Publicado: (2025)

Rates of Convergence in the Central Limit Theorem for Markov Chains, with an Application to TD Learning
por: Srikant, R.
Publicado: (2024)

Tight Finite Time Bounds of Two-Time-Scale Linear Stochastic Approximation with Markovian Noise
por: Haque, Shaan Ul, et al.
Publicado: (2023)

Verification of Neural Control Barrier Functions with Symbolic Derivative Bounds Propagation
por: Hu, Hanjiang, et al.
Publicado: (2024)

Scalable Verification of Neural Control Barrier Functions Using Linear Bound Propagation
por: Vertovec, Nikolaus, et al.
Publicado: (2025)

A Survey on Universal Approximation Theorems
por: Augustine, Midhun T
Publicado: (2024)

A Finite-Time Analysis of TD Learning with Linear Function Approximation without Projections or Strong Convexity
por: Lee, Wei-Cheng, et al.
Publicado: (2025)

Domain Consistent Industrial Decarbonisation of Global Coal Power Plants
por: Ashraf, Waqar Muhammad, et al.
Publicado: (2025)

Stochastic Approximation with Unbounded Markovian Noise: A General-Purpose Theorem
por: Haque, Shaan Ul, et al.
Publicado: (2024)

Certified Neural Approximations of Nonlinear Dynamics
por: Mathiesen, Frederik Baymler, et al.
Publicado: (2025)

Random Features Approximation for Control-Affine Systems
por: Kazemian, Kimia, et al.
Publicado: (2024)

Lagrangian Index Policy for Restless Bandits with Average Reward
por: Avrachenkov, Konstantin, et al.
Publicado: (2024)

Concentration of Cumulative Reward in Markov Decision Processes
por: Sayedana, Borna, et al.
Publicado: (2024)

Function Approximation for Reinforcement Learning Controller for Energy from Spread Waves
por: Sarkar, Soumyendu, et al.
Publicado: (2024)

Closed-Loop Koopman Operator Approximation
por: Dahdah, Steven, et al.
Publicado: (2023)

Worst-Case Regret Bounds for Exploration via Randomized Value Functions
por: Russo, Daniel
Publicado: (2019)

Mobiprox: Supporting Dynamic Approximate Computing on Mobiles
por: Fabjančič, Matevž, et al.
Publicado: (2023)

Quantitative Flow Approximation Properties of Narrow Neural ODEs
por: Elamvazhuthi, Karthik
Publicado: (2025)

Improved Scalable Lipschitz Bounds for Deep Neural Networks
por: Syed, Usman, et al.
Publicado: (2025)

Scalable Multi-modal Model Predictive Control via Duality-based Interaction Predictions
por: Kim, Hansung, et al.
Publicado: (2024)

Efficient Approximation of Volterra Series for High-Dimensional Systems
por: Khoshnan, Navin, et al.
Publicado: (2025)

Approximate Gradient Coding for Distributed Learning with Heterogeneous Stragglers
por: Song, Heekang, et al.
Publicado: (2025)

Correctness Verification of Neural Networks Approximating Differential Equations
por: Ellinas, Petros, et al.
Publicado: (2024)

Neural Approximators for Low-Thrust Trajectory Transfer Cost and Reachability
por: Zhang, Zhong, et al.
Publicado: (2025)

SCAFFLSA: Taming Heterogeneity in Federated Linear Stochastic Approximation and TD Learning
por: Mangold, Paul, et al.
Publicado: (2024)