On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments
Fuente:
arXiv
Saved in:
| Main Author: | |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916781095911424 |
|---|---|
| author | Feinberg, Eugene A. |
| author_facet | Feinberg, Eugene A. |
| contents | This article is dedicated to three fundamental papers on Markov Decision Processes and on control with incomplete observations published by Albert Shiryaev approximately sixty years ago. One of these papers was coauthored with O.V. Viskov. We discuss some of the results and some of many rich ideas presented in these papers and survey some later developments. At the end we mention some recent studies of Albert Shiryaev on Kolmogorov's equations for jump Markov processes and on control of continuous-time jump Markov processes. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_04896 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments Feinberg, Eugene A. Probability Optimization and Control This article is dedicated to three fundamental papers on Markov Decision Processes and on control with incomplete observations published by Albert Shiryaev approximately sixty years ago. One of these papers was coauthored with O.V. Viskov. We discuss some of the results and some of many rich ideas presented in these papers and survey some later developments. At the end we mention some recent studies of Albert Shiryaev on Kolmogorov's equations for jump Markov processes and on control of continuous-time jump Markov processes. |
| title | On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments |
| topic | Probability Optimization and Control |
| url | https://arxiv.org/abs/2506.04896 |