Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2019
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/1905.00107 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910317913571328 |
|---|---|
| author | Balata, Alessandro Ludkovski, Michael Maheshwari, Aditya Palczewski, Jan |
| author_facet | Balata, Alessandro Ludkovski, Michael Maheshwari, Aditya Palczewski, Jan |
| contents | We investigate Monte Carlo based algorithms for solving stochastic control problems with probabilistic constraints. Our motivation comes from microgrid management, where the controller tries to optimally dispatch a diesel generator while maintaining low probability of blackouts. The key question we investigate are empirical simulation procedures for learning the admissible control set that is specified implicitly through a probability constraint on the system state. We propose a variety of relevant statistical tools including logistic regression, Gaussian process regression, quantile regression and support vector machines, which we then incorporate into an overall Regression Monte Carlo (RMC) framework for approximate dynamic programming. Our results indicate that using logistic or Gaussian process regression to estimate the admissibility probability outperforms the other options. Our algorithms offer an efficient and reliable extension of RMC to probability-constrained control. We illustrate our findings with two case studies for the microgrid problem. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_1905_00107 |
| institution | arXiv |
| publishDate | 2019 |
| record_format | arxiv |
| spellingShingle | Statistical Learning for Probability-Constrained Stochastic Optimal Control Balata, Alessandro Ludkovski, Michael Maheshwari, Aditya Palczewski, Jan Optimization and Control Computational Finance We investigate Monte Carlo based algorithms for solving stochastic control problems with probabilistic constraints. Our motivation comes from microgrid management, where the controller tries to optimally dispatch a diesel generator while maintaining low probability of blackouts. The key question we investigate are empirical simulation procedures for learning the admissible control set that is specified implicitly through a probability constraint on the system state. We propose a variety of relevant statistical tools including logistic regression, Gaussian process regression, quantile regression and support vector machines, which we then incorporate into an overall Regression Monte Carlo (RMC) framework for approximate dynamic programming. Our results indicate that using logistic or Gaussian process regression to estimate the admissibility probability outperforms the other options. Our algorithms offer an efficient and reliable extension of RMC to probability-constrained control. We illustrate our findings with two case studies for the microgrid problem. |
| title | Statistical Learning for Probability-Constrained Stochastic Optimal Control |
| topic | Optimization and Control Computational Finance |
| url | https://arxiv.org/abs/1905.00107 |