Inferring System and Optimal Control Parameters of Closed-Loop Systems from Partial Observations
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866929723739734016 |
|---|---|
| author | Geadah, Victor Arbelaiz, Juncal Ritz, Harrison Daw, Nathaniel D. Cohen, Jonathan D. Pillow, Jonathan W. |
| author_facet | Geadah, Victor Arbelaiz, Juncal Ritz, Harrison Daw, Nathaniel D. Cohen, Jonathan D. Pillow, Jonathan W. |
| contents | We consider the joint problem of system identification and inverse optimal control for discrete-time stochastic Linear Quadratic Regulators. We analyze finite and infinite time horizons in a partially observed setting, where the state is observed noisily. To recover closed-loop system parameters, we develop inference methods based on probabilistic state-space model (SSM) techniques. First, we show that the system parameters exhibit non-identifiability in the infinite-horizon from closed-loop measurements, and we provide exact and numerical methods to disentangle the parameters. Second, to improve parameter identifiability, we show that we can further enhance recovery by either (1) incorporating additional partial measurements of the control signals or (2) moving to the finite-horizon setting. We further illustrate the performance of our methodology through numerical examples. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_15014 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Inferring System and Optimal Control Parameters of Closed-Loop Systems from Partial Observations Geadah, Victor Arbelaiz, Juncal Ritz, Harrison Daw, Nathaniel D. Cohen, Jonathan D. Pillow, Jonathan W. Optimization and Control Systems and Control We consider the joint problem of system identification and inverse optimal control for discrete-time stochastic Linear Quadratic Regulators. We analyze finite and infinite time horizons in a partially observed setting, where the state is observed noisily. To recover closed-loop system parameters, we develop inference methods based on probabilistic state-space model (SSM) techniques. First, we show that the system parameters exhibit non-identifiability in the infinite-horizon from closed-loop measurements, and we provide exact and numerical methods to disentangle the parameters. Second, to improve parameter identifiability, we show that we can further enhance recovery by either (1) incorporating additional partial measurements of the control signals or (2) moving to the finite-horizon setting. We further illustrate the performance of our methodology through numerical examples. |
| title | Inferring System and Optimal Control Parameters of Closed-Loop Systems from Partial Observations |
| topic | Optimization and Control Systems and Control |
| url | https://arxiv.org/abs/2502.15014 |