Data-driven Estimation of the Algebraic Riccati Equation for the Discrete-Time Inverse Linear Quadratic Regulator Problem

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Sugiura, Shuhei, Ariizumi, Ryo, Tanemura, Masaya, Asai, Toru, Azuma, Shun-ichi
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914672060399616
author Sugiura, Shuhei
Ariizumi, Ryo
Tanemura, Masaya
Asai, Toru
Azuma, Shun-ichi
author_facet Sugiura, Shuhei
Ariizumi, Ryo
Tanemura, Masaya
Asai, Toru
Azuma, Shun-ichi
contents In this paper, we propose a method for estimating the algebraic Riccati equation (ARE) with respect to an unknown discrete-time system from the system state and input observation. The inverse optimal control (IOC) problem asks, ``What objective function is optimized by a given control system?'' The inverse linear quadratic regulator (ILQR) problem is an IOC problem that assumes a linear system and quadratic objective function. The ILQR problem can be solved by solving a linear matrix inequality that contains the ARE. However, the system model is required to obtain the ARE, and it is often unknown in fields in which the IOC problem occurs, for example, biological system analysis. Our method directly estimates the ARE from the observation data without identifying the system. This feature enables us to economize the observation data using prior information about the objective function. We provide a data condition that is sufficient for our method to estimate the ARE. We conducted a numerical experiment to demonstrate that our method can estimate the ARE with less data than system identification if the prior information is sufficient.
format Preprint
id arxiv_https___arxiv_org_abs_2402_06180
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Data-driven Estimation of the Algebraic Riccati Equation for the Discrete-Time Inverse Linear Quadratic Regulator Problem
Sugiura, Shuhei
Ariizumi, Ryo
Tanemura, Masaya
Asai, Toru
Azuma, Shun-ichi
Optimization and Control
Systems and Control
In this paper, we propose a method for estimating the algebraic Riccati equation (ARE) with respect to an unknown discrete-time system from the system state and input observation. The inverse optimal control (IOC) problem asks, ``What objective function is optimized by a given control system?'' The inverse linear quadratic regulator (ILQR) problem is an IOC problem that assumes a linear system and quadratic objective function. The ILQR problem can be solved by solving a linear matrix inequality that contains the ARE. However, the system model is required to obtain the ARE, and it is often unknown in fields in which the IOC problem occurs, for example, biological system analysis. Our method directly estimates the ARE from the observation data without identifying the system. This feature enables us to economize the observation data using prior information about the objective function. We provide a data condition that is sufficient for our method to estimate the ARE. We conducted a numerical experiment to demonstrate that our method can estimate the ARE with less data than system identification if the prior information is sufficient.
title Data-driven Estimation of the Algebraic Riccati Equation for the Discrete-Time Inverse Linear Quadratic Regulator Problem
topic Optimization and Control
Systems and Control
url https://arxiv.org/abs/2402.06180