Saved in:
Bibliographic Details
Main Authors: Lu, Bing-Ze, Tsai, Richard
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2507.14491
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911615695192064
author Lu, Bing-Ze
Tsai, Richard
author_facet Lu, Bing-Ze
Tsai, Richard
contents In many applications, one needs to learn a dynamical system from its solutions sampled at a finite number of time points. The learning problem is often formulated as an optimization problem over a chosen function class. However, in the optimization procedure, prediction data from generic dynamics requires a numerical integrator to assess the mismatch with the observed data. This paper reveals potentially serious effects of a chosen numerical scheme on the learning outcome. Specifically, the analysis demonstrates that a damped oscillatory system may be incorrectly identified as having "anti-damping" and exhibiting a reversed oscillation direction, even though it adequately fits the given data points. This paper shows that the stability region of the selected integrator will distort the nature of the learned dynamics. Crucially, reducing the step size or raising the order of an explicit integrator does not, in general, remedy this artifact, because higher-order explicit methods have stability regions that extend further into the right half complex plane. Furthermore, it is shown that the implicit midpoint method can preserve either conservative or dissipative properties from discrete data, offering a principled integrator choice even when the only prior knowledge is that the system is autonomous.
format Preprint
id arxiv_https___arxiv_org_abs_2507_14491
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Artifacts of Numerical Integration in Learning Dynamical Systems
Lu, Bing-Ze
Tsai, Richard
Numerical Analysis
Machine Learning
In many applications, one needs to learn a dynamical system from its solutions sampled at a finite number of time points. The learning problem is often formulated as an optimization problem over a chosen function class. However, in the optimization procedure, prediction data from generic dynamics requires a numerical integrator to assess the mismatch with the observed data. This paper reveals potentially serious effects of a chosen numerical scheme on the learning outcome. Specifically, the analysis demonstrates that a damped oscillatory system may be incorrectly identified as having "anti-damping" and exhibiting a reversed oscillation direction, even though it adequately fits the given data points. This paper shows that the stability region of the selected integrator will distort the nature of the learned dynamics. Crucially, reducing the step size or raising the order of an explicit integrator does not, in general, remedy this artifact, because higher-order explicit methods have stability regions that extend further into the right half complex plane. Furthermore, it is shown that the implicit midpoint method can preserve either conservative or dissipative properties from discrete data, offering a principled integrator choice even when the only prior knowledge is that the system is autonomous.
title Artifacts of Numerical Integration in Learning Dynamical Systems
topic Numerical Analysis
Machine Learning
url https://arxiv.org/abs/2507.14491