Imagen de Portada

The ODE Method for Stochastic Approximation and Reinforcement Learning with Markovian Noise

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Liu, Shuze Daniel, Chen, Shuhang, Zhang, Shangtong
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Convergence of Two-Timescale Markovian Stochastic Approximations with Applications in Reinforcement Learning
por: Mahadevan, Vagul, et al.
Publicado: (2026)

Asymptotic and Finite Sample Analysis of Nonexpansive Stochastic Approximations with Markovian Noise
por: Blaser, Ethan, et al.
Publicado: (2024)

Almost Sure Convergence Rates and Concentration of Stochastic Approximation and Reinforcement Learning with Markovian Noise
por: Qian, Xiaochi, et al.
Publicado: (2024)

Doubly Optimal Policy Evaluation for Reinforcement Learning
por: Liu, Shuze Daniel, et al.
Publicado: (2024)

Efficient Multi-Policy Evaluation for Reinforcement Learning
por: Liu, Shuze Daniel, et al.
Publicado: (2024)

Efficient Policy Evaluation with Safety Constraint for Reinforcement Learning
por: Chen, Claire, et al.
Publicado: (2024)

Counterfactual Explanations for Continuous Action Reinforcement Learning
por: Dong, Shuyang, et al.
Publicado: (2025)

The ODE Method for Asymptotic Statistics in Stochastic Approximation and Reinforcement Learning
por: Borkar, Vivek, et al.
Publicado: (2021)

Efficient Policy Evaluation with Offline Data Informed Behavior Policy Design
por: Liu, Shuze, et al.
Publicado: (2023)

Group Fairness in Multi-Task Reinforcement Learning
por: Song, Kefan, et al.
Publicado: (2025)

MathlibLemma: Folklore Lemma Generation and Benchmark for Formal Mathematics
por: Liu, Xinyu, et al.
Publicado: (2026)

Almost Sure Convergence of Linear Temporal Difference Learning with Arbitrary Features
por: Wang, Jiuqi, et al.
Publicado: (2024)

Policy Gradient Methods for Non-Markovian Reinforcement Learning
por: Kar, Avik, et al.
Publicado: (2026)

Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set
por: Liu, Xinyu, et al.
Publicado: (2025)

Adaptive Policy Selection and Fine-Tuning under Interaction Budgets for Offline-to-Online Reinforcement Learning
por: Bozkurt, Alper Kamil, et al.
Publicado: (2026)

Finite Sample Analysis of Linear Temporal Difference Learning with Arbitrary Features
por: Xie, Zixuan, et al.
Publicado: (2025)

Almost Sure Convergence of Differential Temporal Difference Learning for Average Reward Markov Decision Processes
por: Blaser, Ethan, et al.
Publicado: (2026)

Beyond Linear Attention: Softmax Transformers Implement In-Context Reinforcement Learning
por: Xie, Zixuan, et al.
Publicado: (2026)

Reinforcement Learning with Stochastic Reward Machines
por: Corazza, Jan, et al.
Publicado: (2025)

Learning to Remember: End-to-End Training of Memory Agents for Long-Context Reasoning
por: Zhang, Kehao, et al.
Publicado: (2026)

Neural ODE and SDE Models for Adaptation and Planning in Model-Based Reinforcement Learning
por: Han, Chao, et al.
Publicado: (2026)

Safe Reinforcement Learning with Learned Non-Markovian Safety Constraints
por: Low, Siow Meng, et al.
Publicado: (2024)

BULL-ODE: Bullwhip Learning with Neural ODEs and Universal Differential Equations under Stochastic Demand
por: Naik, Nachiket N., et al.
Publicado: (2025)

On the Complexity of Offline Reinforcement Learning with $Q^\star$-Approximation and Partial Coverage
por: Liu, Haolin, et al.
Publicado: (2026)

Hypergraph and Latent ODE Learning for Multimodal Root Cause Localization in Microservices
por: Liu, Xin, et al.
Publicado: (2026)

Directed-MAML: Meta Reinforcement Learning Algorithm with Task-directed Approximation
por: Zhang, Yang, et al.
Publicado: (2025)

Almost Sure Convergence Rates of Stochastic Approximation and Reinforcement Learning via a Poisson-Moreau Drift
por: Liu, Xinyu, et al.
Publicado: (2026)

Experience Replay Addresses Loss of Plasticity in Continual Learning
por: Wang, Jiuqi, et al.
Publicado: (2025)

Spatial-Temporal Reinforcement Learning for Network Routing with Non-Markovian Traffic
por: Wang, Molly, et al.
Publicado: (2025)

SPIN-ODE: Stiff Physics-Informed Neural ODE for Chemical Reaction Rate Estimation
por: Peng, Wenqing, et al.
Publicado: (2025)

MathlibPR: Pull Request Merge-Readiness Benchmark for Formal Mathematical Libraries
por: Xie, Zixuan, et al.
Publicado: (2026)

Learning to Explore with Parameter-Space Noise: A Deep Dive into Parameter-Space Noise for Reinforcement Learning with Verifiable Rewards
por: Bai, Bizhe, et al.
Publicado: (2026)

Stochastic Collapse: How Gradient Noise Attracts SGD Dynamics Towards Simpler Subnetworks
por: Chen, Feng, et al.
Publicado: (2023)

Noise Balance and Stationary Distribution of Stochastic Gradient Descent
por: Ziyin, Liu, et al.
Publicado: (2023)

Mitigating Time Discretization Challenges with WeatherODE: A Sandwich Physics-Driven Neural ODE for Weather Forecasting
por: Liu, Peiyuan, et al.
Publicado: (2024)

Sequential Stochastic Combinatorial Optimization Using Hierarchal Reinforcement Learning
por: Feng, Xinsong, et al.
Publicado: (2025)

Model-Based Reinforcement Learning in Discrete-Action Non-Markovian Reward Decision Processes
por: Trapasso, Alessandro, et al.
Publicado: (2025)

Offline Reinforcement Learning with Penalized Action Noise Injection
por: Oh, JunHyeok, et al.
Publicado: (2025)

Reward Is Enough: LLMs Are In-Context Reinforcement Learners
por: Song, Kefan, et al.
Publicado: (2025)

LASS-ODE: Scaling ODE Computations to Connect Foundation Models with Dynamical Physical Systems
por: Li, Haoran, et al.
Publicado: (2026)