Convergence Analysis of the Upwind Difference Methods for Hamilton-Jacobi-Bellman Equations
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912875638947840 |
|---|---|
| author | Inoue, Daisuke Ito, Yuji Kashiwabara, Takahito Saito, Norikazu Yoshida, Hiroaki |
| author_facet | Inoue, Daisuke Ito, Yuji Kashiwabara, Takahito Saito, Norikazu Yoshida, Hiroaki |
| contents | This paper investigates the convergence properties of the upwind difference scheme for the Hamilton--Jacobi--Bellman (HJB) equation, a central partial differential equation in optimal control theory. First, assuming the existence of a classical solution, we show that the numerical solution converges to the true solution with a first-order rate with respect to the time step. This result complements the square-root rate established in previous studies for viscosity solutions. Second, by exploiting the correspondence between HJB equations and conservation laws, we prove the convergence of the optimal control input. This analysis is crucial for practical applications where the control input is the primary quantity of interest, yet it has rarely been addressed in previous studies. Finally, we confirm the validity of our theoretical results through numerical experiments on typical control problems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2301_06415 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Convergence Analysis of the Upwind Difference Methods for Hamilton-Jacobi-Bellman Equations Inoue, Daisuke Ito, Yuji Kashiwabara, Takahito Saito, Norikazu Yoshida, Hiroaki Numerical Analysis Analysis of PDEs Optimization and Control This paper investigates the convergence properties of the upwind difference scheme for the Hamilton--Jacobi--Bellman (HJB) equation, a central partial differential equation in optimal control theory. First, assuming the existence of a classical solution, we show that the numerical solution converges to the true solution with a first-order rate with respect to the time step. This result complements the square-root rate established in previous studies for viscosity solutions. Second, by exploiting the correspondence between HJB equations and conservation laws, we prove the convergence of the optimal control input. This analysis is crucial for practical applications where the control input is the primary quantity of interest, yet it has rarely been addressed in previous studies. Finally, we confirm the validity of our theoretical results through numerical experiments on typical control problems. |
| title | Convergence Analysis of the Upwind Difference Methods for Hamilton-Jacobi-Bellman Equations |
| topic | Numerical Analysis Analysis of PDEs Optimization and Control |
| url | https://arxiv.org/abs/2301.06415 |