Optimal $H_{\infty}$ control based on stable manifold of discounted Hamilton-Jacobi-Isaacs equation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Chen, Guoyuan, Wang, Yi, Zhou, Qinglong
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910630874710016
author Chen, Guoyuan
Wang, Yi
Zhou, Qinglong
author_facet Chen, Guoyuan
Wang, Yi
Zhou, Qinglong
contents The optimal \(H_{\infty}\) control problem over an infinite time horizon, which incorporates a performance function with a discount factor \(e^{-αt}\) (\(α> 0\)), is important in various fields. Solving this optimal \(H_{\infty}\) control problem is equivalent to addressing a discounted Hamilton-Jacobi-Isaacs (HJI) partial differential equation. In this paper, we first provide a precise estimate for the discount factor \(α\) that ensures the existence of a nonnegative stabilizing solution to the HJI equation. This stabilizing solution corresponds to the stable manifold of the characteristic system of the HJI equation, which is a contact Hamiltonian system due to the presence of the discount factor. Secondly, we demonstrate that approximating the optimal controller in a natural manner results in a closed-loop system with a finite \(L_2\)-gain that is nearly less than the gain of the original system. Thirdly, based on the theoretical results obtained, we propose a deep learning algorithm to approximate the optimal controller using the stable manifold of the contact Hamiltonian system associated with the HJI equation. Finally, we apply our method to the \(H_{\infty}\) control of the Allen-Cahn equation to illustrate its effectiveness.
format Preprint
id arxiv_https___arxiv_org_abs_2410_02272
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Optimal $H_{\infty}$ control based on stable manifold of discounted Hamilton-Jacobi-Isaacs equation
Chen, Guoyuan
Wang, Yi
Zhou, Qinglong
Optimization and Control
Systems and Control
The optimal \(H_{\infty}\) control problem over an infinite time horizon, which incorporates a performance function with a discount factor \(e^{-αt}\) (\(α> 0\)), is important in various fields. Solving this optimal \(H_{\infty}\) control problem is equivalent to addressing a discounted Hamilton-Jacobi-Isaacs (HJI) partial differential equation. In this paper, we first provide a precise estimate for the discount factor \(α\) that ensures the existence of a nonnegative stabilizing solution to the HJI equation. This stabilizing solution corresponds to the stable manifold of the characteristic system of the HJI equation, which is a contact Hamiltonian system due to the presence of the discount factor. Secondly, we demonstrate that approximating the optimal controller in a natural manner results in a closed-loop system with a finite \(L_2\)-gain that is nearly less than the gain of the original system. Thirdly, based on the theoretical results obtained, we propose a deep learning algorithm to approximate the optimal controller using the stable manifold of the contact Hamiltonian system associated with the HJI equation. Finally, we apply our method to the \(H_{\infty}\) control of the Allen-Cahn equation to illustrate its effectiveness.
title Optimal $H_{\infty}$ control based on stable manifold of discounted Hamilton-Jacobi-Isaacs equation
topic Optimization and Control
Systems and Control
url https://arxiv.org/abs/2410.02272