On the Effect of Instability on Learning Continuous-Time Linear Control Systems

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Hafshejani, Reza Sadeghi, Fradonbeh, Mohamad Kazem Shirani
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912613837832192
author Hafshejani, Reza Sadeghi
Fradonbeh, Mohamad Kazem Shirani
author_facet Hafshejani, Reza Sadeghi
Fradonbeh, Mohamad Kazem Shirani
contents We study the problem of system identification for stochastic continuous-time dynamics, based on a single finite-length state trajectory. We present a method for estimating the possibly unstable open-loop matrix by employing properly randomized control inputs. Then, we establish theoretical performance guarantees showing that the estimation error decays with trajectory length, a measure of excitability, and the signal-to-noise ratio, while it grows with dimension. Numerical illustrations that showcase the rates of learning the dynamics, will be provided as well. To perform the theoretical analysis, we develop new technical tools that are of independent interest. That includes non-asymptotic stochastic bounds for highly non-stationary martingales and generalized laws of iterated logarithms, among others.
format Preprint
id arxiv_https___arxiv_org_abs_2409_11327
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle On the Effect of Instability on Learning Continuous-Time Linear Control Systems
Hafshejani, Reza Sadeghi
Fradonbeh, Mohamad Kazem Shirani
Machine Learning
We study the problem of system identification for stochastic continuous-time dynamics, based on a single finite-length state trajectory. We present a method for estimating the possibly unstable open-loop matrix by employing properly randomized control inputs. Then, we establish theoretical performance guarantees showing that the estimation error decays with trajectory length, a measure of excitability, and the signal-to-noise ratio, while it grows with dimension. Numerical illustrations that showcase the rates of learning the dynamics, will be provided as well. To perform the theoretical analysis, we develop new technical tools that are of independent interest. That includes non-asymptotic stochastic bounds for highly non-stationary martingales and generalized laws of iterated logarithms, among others.
title On the Effect of Instability on Learning Continuous-Time Linear Control Systems
topic Machine Learning
url https://arxiv.org/abs/2409.11327