Identifiability and Asymptotics in Learning Homogeneous Linear ODE Systems from Discrete Observations

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wang, Yuanyuan, Huang, Wei, Gong, Mingming, Geng, Xi, Liu, Tongliang, Zhang, Kun, Tao, Dacheng
Formato: Preprint
Publicado: 2022
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917681006903296
author Wang, Yuanyuan
Huang, Wei
Gong, Mingming
Geng, Xi
Liu, Tongliang
Zhang, Kun
Tao, Dacheng
author_facet Wang, Yuanyuan
Huang, Wei
Gong, Mingming
Geng, Xi
Liu, Tongliang
Zhang, Kun
Tao, Dacheng
contents Ordinary Differential Equations (ODEs) have recently gained a lot of attention in machine learning. However, the theoretical aspects, e.g., identifiability and asymptotic properties of statistical estimation are still obscure. This paper derives a sufficient condition for the identifiability of homogeneous linear ODE systems from a sequence of equally-spaced error-free observations sampled from a single trajectory. When observations are disturbed by measurement noise, we prove that under mild conditions, the parameter estimator based on the Nonlinear Least Squares (NLS) method is consistent and asymptotic normal with $n^{-1/2}$ convergence rate. Based on the asymptotic normality property, we construct confidence sets for the unknown system parameters and propose a new method to infer the causal structure of the ODE system, i.e., inferring whether there is a causal link between system variables. Furthermore, we extend the results to degraded observations, including aggregated and time-scaled ones. To the best of our knowledge, our work is the first systematic study of the identifiability and asymptotic properties in learning linear ODE systems. We also construct simulations with various system dimensions to illustrate the established theoretical results.
format Preprint
id arxiv_https___arxiv_org_abs_2210_05955
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Identifiability and Asymptotics in Learning Homogeneous Linear ODE Systems from Discrete Observations
Wang, Yuanyuan
Huang, Wei
Gong, Mingming
Geng, Xi
Liu, Tongliang
Zhang, Kun
Tao, Dacheng
Machine Learning
Ordinary Differential Equations (ODEs) have recently gained a lot of attention in machine learning. However, the theoretical aspects, e.g., identifiability and asymptotic properties of statistical estimation are still obscure. This paper derives a sufficient condition for the identifiability of homogeneous linear ODE systems from a sequence of equally-spaced error-free observations sampled from a single trajectory. When observations are disturbed by measurement noise, we prove that under mild conditions, the parameter estimator based on the Nonlinear Least Squares (NLS) method is consistent and asymptotic normal with $n^{-1/2}$ convergence rate. Based on the asymptotic normality property, we construct confidence sets for the unknown system parameters and propose a new method to infer the causal structure of the ODE system, i.e., inferring whether there is a causal link between system variables. Furthermore, we extend the results to degraded observations, including aggregated and time-scaled ones. To the best of our knowledge, our work is the first systematic study of the identifiability and asymptotic properties in learning linear ODE systems. We also construct simulations with various system dimensions to illustrate the established theoretical results.
title Identifiability and Asymptotics in Learning Homogeneous Linear ODE Systems from Discrete Observations
topic Machine Learning
url https://arxiv.org/abs/2210.05955