Smooth approximation of feedback laws for infinite horizon control problems with non-smooth value functions
Fuente:
arXiv
Guardado en:
| Autores principales: | , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2023
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866916131726426112 |
|---|---|
| author | Kunisch, Karl Vásquez-Varas, Donato |
| author_facet | Kunisch, Karl Vásquez-Varas, Donato |
| contents | In this work the synthesis of approximate optimal and smooth feedback laws for infinite horizon optimal control problems is addressed. In this regards, $L^{p}$ type error bounds of the approximating smooth feedback laws are derived, depending on either the $C^1$ norm of the value function or its semi-concavity. These error bounds combined with the existence of a Lyapunov type function are used to prove the existence of an approximate optimal sequence of smooth feedback laws. Moreover, we extend this result to the Hölder continuous case by a diagonalization argument combined with the Moreau envelope. It is foreseen that these error bounds could be applied to study the convergence of synthesis of feedback laws via data driven machine learning methods. Additionally, we provide an example of an infinite horizon optimal control problem for which the value functions is non-differentiable but Lipschitz continuous. We point out that in this example no restrictions on either the controls or the trajectories are assumed. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_11981 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Smooth approximation of feedback laws for infinite horizon control problems with non-smooth value functions Kunisch, Karl Vásquez-Varas, Donato Optimization and Control 49L12, 49L25, 49N35, 93B52, 35D40 In this work the synthesis of approximate optimal and smooth feedback laws for infinite horizon optimal control problems is addressed. In this regards, $L^{p}$ type error bounds of the approximating smooth feedback laws are derived, depending on either the $C^1$ norm of the value function or its semi-concavity. These error bounds combined with the existence of a Lyapunov type function are used to prove the existence of an approximate optimal sequence of smooth feedback laws. Moreover, we extend this result to the Hölder continuous case by a diagonalization argument combined with the Moreau envelope. It is foreseen that these error bounds could be applied to study the convergence of synthesis of feedback laws via data driven machine learning methods. Additionally, we provide an example of an infinite horizon optimal control problem for which the value functions is non-differentiable but Lipschitz continuous. We point out that in this example no restrictions on either the controls or the trajectories are assumed. |
| title | Smooth approximation of feedback laws for infinite horizon control problems with non-smooth value functions |
| topic | Optimization and Control 49L12, 49L25, 49N35, 93B52, 35D40 |
| url | https://arxiv.org/abs/2312.11981 |