Online Algorithms for Recovery of Low-Rank Parameter Matrix in Non-stationary Stochastic Systems

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Fu, Yanxin, Zhou, Junbao, Hu, Yu, Zhao, Wenxiao
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908418974941184
author Fu, Yanxin
Zhou, Junbao
Hu, Yu
Zhao, Wenxiao
author_facet Fu, Yanxin
Zhou, Junbao
Hu, Yu
Zhao, Wenxiao
contents This paper presents a two-stage online algorithm for recovery of low-rank parameter matrix in non-stationary stochastic systems. The first stage applies the recursive least squares (RLS) estimator combined with its singular value decomposition to estimate the unknown parameter matrix within the system, leveraging RLS for adaptability and SVD to reveal low-rank structure. The second stage introduces a weighted nuclear norm regularization criterion function, where adaptive weights derived from the first-stage enhance low-rank constraints. The regularization criterion admits an explicit and online computable solution, enabling efficient online updates when new data arrive without reprocessing historical data. Under the non-stationary and the non-persistent excitation conditions on the systems, the algorithm provably achieves: (i) the true rank of the unknown parameter matrix can be identified with a finite number of observations, (ii) the values of the matrix components can be consistently estimated as the number of observations increases, and (iii) the asymptotical normality of the algorithm is established as well. Such properties are termed oracle properties in the literature. Numerical simulations validate performance of the algorithm in estimation accuracy.
format Preprint
id arxiv_https___arxiv_org_abs_2506_19299
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Online Algorithms for Recovery of Low-Rank Parameter Matrix in Non-stationary Stochastic Systems
Fu, Yanxin
Zhou, Junbao
Hu, Yu
Zhao, Wenxiao
Systems and Control
This paper presents a two-stage online algorithm for recovery of low-rank parameter matrix in non-stationary stochastic systems. The first stage applies the recursive least squares (RLS) estimator combined with its singular value decomposition to estimate the unknown parameter matrix within the system, leveraging RLS for adaptability and SVD to reveal low-rank structure. The second stage introduces a weighted nuclear norm regularization criterion function, where adaptive weights derived from the first-stage enhance low-rank constraints. The regularization criterion admits an explicit and online computable solution, enabling efficient online updates when new data arrive without reprocessing historical data. Under the non-stationary and the non-persistent excitation conditions on the systems, the algorithm provably achieves: (i) the true rank of the unknown parameter matrix can be identified with a finite number of observations, (ii) the values of the matrix components can be consistently estimated as the number of observations increases, and (iii) the asymptotical normality of the algorithm is established as well. Such properties are termed oracle properties in the literature. Numerical simulations validate performance of the algorithm in estimation accuracy.
title Online Algorithms for Recovery of Low-Rank Parameter Matrix in Non-stationary Stochastic Systems
topic Systems and Control
url https://arxiv.org/abs/2506.19299