Markov Decision Process Design: A Framework for Integrating Strategic and Operational Decisions
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909145595117568 |
|---|---|
| author | Brown, Seth Sinha, Saumya Schaefer, Andrew J |
| author_facet | Brown, Seth Sinha, Saumya Schaefer, Andrew J |
| contents | We consider the problem of optimally designing a system for repeated use under uncertainty. We develop a modeling framework that integrates design and operational phases, which are represented by a mixed-integer program and discounted-cost infinite-horizon Markov decision processes, respectively. We seek to simultaneously minimize the design costs and the subsequent expected operational costs. This problem setting arises naturally in several application areas, as we illustrate through examples. We derive a bilevel mixed-integer linear programming formulation for the problem and perform a computational study to demonstrate that realistic instances can be solved numerically. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2304_03765 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Markov Decision Process Design: A Framework for Integrating Strategic and Operational Decisions Brown, Seth Sinha, Saumya Schaefer, Andrew J Optimization and Control Systems and Control We consider the problem of optimally designing a system for repeated use under uncertainty. We develop a modeling framework that integrates design and operational phases, which are represented by a mixed-integer program and discounted-cost infinite-horizon Markov decision processes, respectively. We seek to simultaneously minimize the design costs and the subsequent expected operational costs. This problem setting arises naturally in several application areas, as we illustrate through examples. We derive a bilevel mixed-integer linear programming formulation for the problem and perform a computational study to demonstrate that realistic instances can be solved numerically. |
| title | Markov Decision Process Design: A Framework for Integrating Strategic and Operational Decisions |
| topic | Optimization and Control Systems and Control |
| url | https://arxiv.org/abs/2304.03765 |