An efficient gradient projection method for stochastic optimal control problem with expected integral state constraint
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915076198367232 |
|---|---|
| author | Wang, Qiming Liu, Wenbin |
| author_facet | Wang, Qiming Liu, Wenbin |
| contents | In this work, we present an efficient gradient projection method for solving a class of stochastic optimal control problem with expected integral state constraint. The first order optimality condition system consisting of forward-backward stochastic differential equations and a variational equation is first derived. Then, an efficient gradient projection method with linear drift coefficient is proposed where the state constraint is guaranteed by constructing specific multiplier. Further, the Euler method is used to discretize the forward-backward stochastic differential equations and the associated conditional expectations are approximated by the least square Monte Carlo method, yielding the fully discrete iterative scheme. Error estimates of control and multiplier are presented, showing that the method admits first order convergence. Finally we present numerical examples to support the theoretical findings. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_17363 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | An efficient gradient projection method for stochastic optimal control problem with expected integral state constraint Wang, Qiming Liu, Wenbin Optimization and Control 60H35, 65K10, 65C20, 93E20 In this work, we present an efficient gradient projection method for solving a class of stochastic optimal control problem with expected integral state constraint. The first order optimality condition system consisting of forward-backward stochastic differential equations and a variational equation is first derived. Then, an efficient gradient projection method with linear drift coefficient is proposed where the state constraint is guaranteed by constructing specific multiplier. Further, the Euler method is used to discretize the forward-backward stochastic differential equations and the associated conditional expectations are approximated by the least square Monte Carlo method, yielding the fully discrete iterative scheme. Error estimates of control and multiplier are presented, showing that the method admits first order convergence. Finally we present numerical examples to support the theoretical findings. |
| title | An efficient gradient projection method for stochastic optimal control problem with expected integral state constraint |
| topic | Optimization and Control 60H35, 65K10, 65C20, 93E20 |
| url | https://arxiv.org/abs/2412.17363 |