Sample Complexity for Markov Decision Processes and Stochastic Optimal Control with Static Risk Measures
Fuente:
arXiv
Salvato in:
| Autori principali: | , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917386395844608 |
|---|---|
| author | Chávez, Cristian Li, Yan |
| author_facet | Chávez, Cristian Li, Yan |
| contents | We present an elementary state augmentation method for a class of static risk measure applied to the total cost for both Markov decision processes and stochastic optimal control, such that dynamic programming equations can be derived on the augmented space. Through this we discuss the sample complexities of these two problems for both finite-horizon and infinite-horizon settings. We demonstrate the application of the proposed approach through studying distributionally robust functional generated by $ϕ$-divergences including conditional value-at-risk. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_04795 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Sample Complexity for Markov Decision Processes and Stochastic Optimal Control with Static Risk Measures Chávez, Cristian Li, Yan Optimization and Control We present an elementary state augmentation method for a class of static risk measure applied to the total cost for both Markov decision processes and stochastic optimal control, such that dynamic programming equations can be derived on the augmented space. Through this we discuss the sample complexities of these two problems for both finite-horizon and infinite-horizon settings. We demonstrate the application of the proposed approach through studying distributionally robust functional generated by $ϕ$-divergences including conditional value-at-risk. |
| title | Sample Complexity for Markov Decision Processes and Stochastic Optimal Control with Static Risk Measures |
| topic | Optimization and Control |
| url | https://arxiv.org/abs/2604.04795 |