Reinforcement Learning Framework For Stochastic Optimal Control Problem Under Model Uncertainty

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Hou, Jiaxuan, Wei, Lifeng
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917070594113536
author Hou, Jiaxuan
Wei, Lifeng
author_facet Hou, Jiaxuan
Wei, Lifeng
contents We develop a continuous-time entropy-regularized reinforcement learning framework under model uncertainty. By applying Sion's minimax theorem, we transform the intractable robust control problem into an equivalent standard entropy-regularized stochastic control problem, facilitating reinforcement learning algorithms. We establish sufficient conditions for the theorem's validity and demonstrate our approach on linear-quadratic problems with uncertain model parameters following Bernoulli and uniform distributions.
format Preprint
id arxiv_https___arxiv_org_abs_2511_06881
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Reinforcement Learning Framework For Stochastic Optimal Control Problem Under Model Uncertainty
Hou, Jiaxuan
Wei, Lifeng
Optimization and Control
We develop a continuous-time entropy-regularized reinforcement learning framework under model uncertainty. By applying Sion's minimax theorem, we transform the intractable robust control problem into an equivalent standard entropy-regularized stochastic control problem, facilitating reinforcement learning algorithms. We establish sufficient conditions for the theorem's validity and demonstrate our approach on linear-quadratic problems with uncertain model parameters following Bernoulli and uniform distributions.
title Reinforcement Learning Framework For Stochastic Optimal Control Problem Under Model Uncertainty
topic Optimization and Control
url https://arxiv.org/abs/2511.06881