Nonconvex Linear System Identification with Minimal State Representation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Tadipatri, Uday Kiran Reddy, Haeffele, Benjamin D., Agterberg, Joshua, Ziemann, Ingvar, Vidal, René
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915323243921408
author Tadipatri, Uday Kiran Reddy
Haeffele, Benjamin D.
Agterberg, Joshua
Ziemann, Ingvar
Vidal, René
author_facet Tadipatri, Uday Kiran Reddy
Haeffele, Benjamin D.
Agterberg, Joshua
Ziemann, Ingvar
Vidal, René
contents Low-order linear System IDentification (SysID) addresses the challenge of estimating the parameters of a linear dynamical system from finite samples of observations and control inputs with minimal state representation. Traditional approaches often utilize Hankel-rank minimization, which relies on convex relaxations that can require numerous, costly singular value decompositions (SVDs) to optimize. In this work, we propose two nonconvex reformulations to tackle low-order SysID (i) Burer-Monterio (BM) factorization of the Hankel matrix for efficient nuclear norm minimization, and (ii) optimizing directly over system parameters for real, diagonalizable systems with an atomic norm style decomposition. These reformulations circumvent the need for repeated heavy SVD computations, significantly improving computational efficiency. Moreover, we prove that optimizing directly over the system parameters yields lower statistical error rates, and lower sample complexities that do not scale linearly with trajectory length like in Hankel-nuclear norm minimization. Additionally, while our proposed formulations are nonconvex, we provide theoretical guarantees of achieving global optimality in polynomial time. Finally, we demonstrate algorithms that solve these nonconvex programs and validate our theoretical claims on synthetic data.
format Preprint
id arxiv_https___arxiv_org_abs_2504_18791
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Nonconvex Linear System Identification with Minimal State Representation
Tadipatri, Uday Kiran Reddy
Haeffele, Benjamin D.
Agterberg, Joshua
Ziemann, Ingvar
Vidal, René
Systems and Control
Machine Learning
Signal Processing
Low-order linear System IDentification (SysID) addresses the challenge of estimating the parameters of a linear dynamical system from finite samples of observations and control inputs with minimal state representation. Traditional approaches often utilize Hankel-rank minimization, which relies on convex relaxations that can require numerous, costly singular value decompositions (SVDs) to optimize. In this work, we propose two nonconvex reformulations to tackle low-order SysID (i) Burer-Monterio (BM) factorization of the Hankel matrix for efficient nuclear norm minimization, and (ii) optimizing directly over system parameters for real, diagonalizable systems with an atomic norm style decomposition. These reformulations circumvent the need for repeated heavy SVD computations, significantly improving computational efficiency. Moreover, we prove that optimizing directly over the system parameters yields lower statistical error rates, and lower sample complexities that do not scale linearly with trajectory length like in Hankel-nuclear norm minimization. Additionally, while our proposed formulations are nonconvex, we provide theoretical guarantees of achieving global optimality in polynomial time. Finally, we demonstrate algorithms that solve these nonconvex programs and validate our theoretical claims on synthetic data.
title Nonconvex Linear System Identification with Minimal State Representation
topic Systems and Control
Machine Learning
Signal Processing
url https://arxiv.org/abs/2504.18791