Policy stability and ultimate stationarity in discounted risk-sensitive stochastic control
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915722418978816 |
|---|---|
| author | Bäuerle, Nicole Pitera, Marcin Stettner, Łukasz |
| author_facet | Bäuerle, Nicole Pitera, Marcin Stettner, Łukasz |
| contents | We study discrete-time Markov Decision Processes (MDPs) on finite state-action spaces and analyze the stability of optimal policies and value functions in the long-run discounted risk-sensitive objective setting. Our analysis addresses robustness with respect to perturbations of the risk-aversion parameter and the discount factor, the emergence of ultimate stationarity, and the interaction between discounted and averaged formulations under suitable mixing assumptions. We further investigate limiting regimes associated with vanishing discount and vanishing risk sensitivity, and discuss the role of Blackwell-type stability properties in the discounted setting. Finally, we provide numerical illustrations that highlight the intrinsic non-stationarity of optimal discounted risk-sensitive policies. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_06998 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Policy stability and ultimate stationarity in discounted risk-sensitive stochastic control Bäuerle, Nicole Pitera, Marcin Stettner, Łukasz Optimization and Control Probability 60J05, 60J35, 90C39, 90C40, 93C55, 93E20 We study discrete-time Markov Decision Processes (MDPs) on finite state-action spaces and analyze the stability of optimal policies and value functions in the long-run discounted risk-sensitive objective setting. Our analysis addresses robustness with respect to perturbations of the risk-aversion parameter and the discount factor, the emergence of ultimate stationarity, and the interaction between discounted and averaged formulations under suitable mixing assumptions. We further investigate limiting regimes associated with vanishing discount and vanishing risk sensitivity, and discuss the role of Blackwell-type stability properties in the discounted setting. Finally, we provide numerical illustrations that highlight the intrinsic non-stationarity of optimal discounted risk-sensitive policies. |
| title | Policy stability and ultimate stationarity in discounted risk-sensitive stochastic control |
| topic | Optimization and Control Probability 60J05, 60J35, 90C39, 90C40, 93C55, 93E20 |
| url | https://arxiv.org/abs/2601.06998 |