Robust Learning of Heterogeneous Dynamic Systems

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xu, Shuoxun, Guo, Zijian, Staveland, Brooke R., Knight, Robert T., Li, Lexin
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913009419419648
author Xu, Shuoxun
Guo, Zijian
Staveland, Brooke R.
Knight, Robert T.
Li, Lexin
author_facet Xu, Shuoxun
Guo, Zijian
Staveland, Brooke R.
Knight, Robert T.
Li, Lexin
contents Ordinary differential equations (ODEs) provide a powerful framework for modeling dynamic systems arising in a wide range of scientific domains. However, most existing ODE methods focus on a single system, and do not adequately address the problem of learning shared patterns from multiple heterogeneous dynamic systems. In this article, we propose a novel distributionally robust learning approach for modeling heterogeneous ODE systems. Specifically, we construct a robust dynamic system by maximizing a worst-case reward over an uncertainty class formed by convex combinations of the derivatives of trajectories. We show the resulting estimator admits an explicit weighted average representation, where the weights are obtained from a quadratic optimization that balances information across multiple data sources. We further develop a bi-level stabilization procedure to address potential instability in estimation. We establish rigorous theoretical guarantees for the proposed method, including consistency of the stabilized weights, error bound for robust trajectory estimation, and asymptotical validity of pointwise confidence interval. We demonstrate that the proposed method considerably improves the generalization performance compared to the alternative solutions through both extensive simulations and the analysis of an intracranial electroencephalogram data.
format Preprint
id arxiv_https___arxiv_org_abs_2604_05285
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Robust Learning of Heterogeneous Dynamic Systems
Xu, Shuoxun
Guo, Zijian
Staveland, Brooke R.
Knight, Robert T.
Li, Lexin
Methodology
Machine Learning
Ordinary differential equations (ODEs) provide a powerful framework for modeling dynamic systems arising in a wide range of scientific domains. However, most existing ODE methods focus on a single system, and do not adequately address the problem of learning shared patterns from multiple heterogeneous dynamic systems. In this article, we propose a novel distributionally robust learning approach for modeling heterogeneous ODE systems. Specifically, we construct a robust dynamic system by maximizing a worst-case reward over an uncertainty class formed by convex combinations of the derivatives of trajectories. We show the resulting estimator admits an explicit weighted average representation, where the weights are obtained from a quadratic optimization that balances information across multiple data sources. We further develop a bi-level stabilization procedure to address potential instability in estimation. We establish rigorous theoretical guarantees for the proposed method, including consistency of the stabilized weights, error bound for robust trajectory estimation, and asymptotical validity of pointwise confidence interval. We demonstrate that the proposed method considerably improves the generalization performance compared to the alternative solutions through both extensive simulations and the analysis of an intracranial electroencephalogram data.
title Robust Learning of Heterogeneous Dynamic Systems
topic Methodology
Machine Learning
url https://arxiv.org/abs/2604.05285