A note on weak compactness of occupation measures for an absorbing Markov decision process
Fuente:
arXiv
Guardado en:
| Autores principales: | , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866929330291998720 |
|---|---|
| author | Dufour, François Prieto-Rumeau, Tomás |
| author_facet | Dufour, François Prieto-Rumeau, Tomás |
| contents | We consider an absorbing Markov decision process with Borel state and action spaces. We study conditions under which the MDP is uniformly absorbing and the set of occupation measures of the MDP is compact in the usual weak topology. These include suitable continuity requirements on the transition kernel and conditions on the dynamics of the system at the boundary of the absorbing set. We generalize previously known results and give an answer to some conjectures that have been mentioned in the related literature. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_10672 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A note on weak compactness of occupation measures for an absorbing Markov decision process Dufour, François Prieto-Rumeau, Tomás Probability Optimization and Control 90C40 We consider an absorbing Markov decision process with Borel state and action spaces. We study conditions under which the MDP is uniformly absorbing and the set of occupation measures of the MDP is compact in the usual weak topology. These include suitable continuity requirements on the transition kernel and conditions on the dynamics of the system at the boundary of the absorbing set. We generalize previously known results and give an answer to some conjectures that have been mentioned in the related literature. |
| title | A note on weak compactness of occupation measures for an absorbing Markov decision process |
| topic | Probability Optimization and Control 90C40 |
| url | https://arxiv.org/abs/2402.10672 |