Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2412.16538 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929644119261184 |
|---|---|
| author | Liu, Chang Fan, Hongtao Li, Yajing |
| author_facet | Liu, Chang Fan, Hongtao Li, Yajing |
| contents | This paper addresses a class of two-person zero-sum stochastic differential equations, which encompass Markov chains and fractional Brownian motion, and satisfy some monotonicity conditions over an infinite time horizon. Within the framework of forward-backward stochastic differential equations (FBSDEs) that describe system evolution, we extend the classical It$\rm\hat{o}$'s formula to accommodate complex scenarios involving Brownian motion, fractional Brownian motion, and Markov chains simultaneously. By applying the Banach fixed-point theorem and approximation methods respectively, we theoretically guarantee the existence and uniqueness of solutions for FBSDEs in infinite horizon. Furthermore, we apply the method for the first time to the optimal control problem in a two-player zero-sum game, deriving the optimal control strategies for both players by solving the FBSDEs system. Finally, we conduct an analysis of the impact of the cross-term
$S(\cdot)$ in the cost function on the solution, revealing its crucial role in the optimization process. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_16538 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Two-person zero-sum stochastic linear quadratic control problems with Markov chains and fractional Brownian motion in infinite horizon Liu, Chang Fan, Hongtao Li, Yajing Optimization and Control This paper addresses a class of two-person zero-sum stochastic differential equations, which encompass Markov chains and fractional Brownian motion, and satisfy some monotonicity conditions over an infinite time horizon. Within the framework of forward-backward stochastic differential equations (FBSDEs) that describe system evolution, we extend the classical It$\rm\hat{o}$'s formula to accommodate complex scenarios involving Brownian motion, fractional Brownian motion, and Markov chains simultaneously. By applying the Banach fixed-point theorem and approximation methods respectively, we theoretically guarantee the existence and uniqueness of solutions for FBSDEs in infinite horizon. Furthermore, we apply the method for the first time to the optimal control problem in a two-player zero-sum game, deriving the optimal control strategies for both players by solving the FBSDEs system. Finally, we conduct an analysis of the impact of the cross-term $S(\cdot)$ in the cost function on the solution, revealing its crucial role in the optimization process. |
| title | Two-person zero-sum stochastic linear quadratic control problems with Markov chains and fractional Brownian motion in infinite horizon |
| topic | Optimization and Control |
| url | https://arxiv.org/abs/2412.16538 |