A Class of Convex Optimization-Based Recursive Algorithms for Identification of Stochastic Systems

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ding, Mingxia, Zhao, Wenxiao, Chen, Tianshi
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909200870801408
author Ding, Mingxia
Zhao, Wenxiao
Chen, Tianshi
author_facet Ding, Mingxia
Zhao, Wenxiao
Chen, Tianshi
contents Focusing on identification, this paper develops a class of convex optimization-based criteria and correspondingly the recursive algorithms to estimate the parameter vector $θ^{*}$ of a stochastic dynamic system. Not only do the criteria include the classical least-squares estimator but also the $L_l=|\cdot|^l, l\geq 1$, the Huber, the Log-cosh, and the Quantile costs as special cases. First, we prove that the minimizers of the convex optimization-based criteria converge to $θ^{*}$ with probability one. Second, the recursive algorithms are proposed to find the estimates, which minimize the convex optimization-based criteria, and it is shown that these estimates also converge to the true parameter vector with probability one. Numerical examples are given, justifying the performance of the proposed algorithms including the strong consistency of the estimates, the robustness against outliers in the observations, and higher efficiency in online computation compared with the kernel-based regularization method due to the recursive nature.
format Preprint
id arxiv_https___arxiv_org_abs_2405_07483
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Class of Convex Optimization-Based Recursive Algorithms for Identification of Stochastic Systems
Ding, Mingxia
Zhao, Wenxiao
Chen, Tianshi
Optimization and Control
Systems and Control
Focusing on identification, this paper develops a class of convex optimization-based criteria and correspondingly the recursive algorithms to estimate the parameter vector $θ^{*}$ of a stochastic dynamic system. Not only do the criteria include the classical least-squares estimator but also the $L_l=|\cdot|^l, l\geq 1$, the Huber, the Log-cosh, and the Quantile costs as special cases. First, we prove that the minimizers of the convex optimization-based criteria converge to $θ^{*}$ with probability one. Second, the recursive algorithms are proposed to find the estimates, which minimize the convex optimization-based criteria, and it is shown that these estimates also converge to the true parameter vector with probability one. Numerical examples are given, justifying the performance of the proposed algorithms including the strong consistency of the estimates, the robustness against outliers in the observations, and higher efficiency in online computation compared with the kernel-based regularization method due to the recursive nature.
title A Class of Convex Optimization-Based Recursive Algorithms for Identification of Stochastic Systems
topic Optimization and Control
Systems and Control
url https://arxiv.org/abs/2405.07483