Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2503.06055 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917233020633088 |
|---|---|
| author | Peng, Nisha Stachurski, John |
| author_facet | Peng, Nisha Stachurski, John |
| contents | New approaches to the theory of dynamic programming view dynamic programs as families of policy operators acting on partially ordered sets. In this paper, we extend these ideas by shifting from arbitrary partially ordered sets to ordered vector spaces. The integrated algebraic and order structure in such spaces leads to sharper fixed point results. These fixed point results can then be exploited to obtain optimality properties. We illustrate our results through applications ranging from firm management to data valuation. These applications include features from the recent literature on dynamic programming, including risk-sensitive preferences, nonlinear discounting, and state-dependent discounting. In all cases we establish existence of optimal policies, characterize them in terms of Bellman optimality relationships, and prove convergence of major algorithms. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_06055 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Dynamic Programming in Ordered Vector Space Peng, Nisha Stachurski, John Optimization and Control New approaches to the theory of dynamic programming view dynamic programs as families of policy operators acting on partially ordered sets. In this paper, we extend these ideas by shifting from arbitrary partially ordered sets to ordered vector spaces. The integrated algebraic and order structure in such spaces leads to sharper fixed point results. These fixed point results can then be exploited to obtain optimality properties. We illustrate our results through applications ranging from firm management to data valuation. These applications include features from the recent literature on dynamic programming, including risk-sensitive preferences, nonlinear discounting, and state-dependent discounting. In all cases we establish existence of optimal policies, characterize them in terms of Bellman optimality relationships, and prove convergence of major algorithms. |
| title | Dynamic Programming in Ordered Vector Space |
| topic | Optimization and Control |
| url | https://arxiv.org/abs/2503.06055 |