When is a System Discoverable from Data? Discovery Requires Chaos

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Shumaylov, Zakhar, Zaika, Peter, Scholl, Philipp, Kutyniok, Gitta, Horesh, Lior, Schönlieb, Carola-Bibiane
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914152894693376
author Shumaylov, Zakhar
Zaika, Peter
Scholl, Philipp
Kutyniok, Gitta
Horesh, Lior
Schönlieb, Carola-Bibiane
author_facet Shumaylov, Zakhar
Zaika, Peter
Scholl, Philipp
Kutyniok, Gitta
Horesh, Lior
Schönlieb, Carola-Bibiane
contents The deep learning revolution has spurred a rise in advances of using AI in sciences. Within physical sciences the main focus has been on discovery of dynamical systems from observational data. Yet the reliability of learned surrogates and symbolic models is often undermined by the fundamental problem of non-uniqueness. The resulting models may fit the available data perfectly, but lack genuine predictive power. This raises the question: under what conditions can the systems governing equations be uniquely identified from a finite set of observations? We show, counter-intuitively, that chaos, typically associated with unpredictability, is crucial for ensuring a system is discoverable in the space of continuous or analytic functions. The prevalence of chaotic systems in benchmark datasets may have inadvertently obscured this fundamental limitation. More concretely, we show that systems chaotic on their entire domain are discoverable from a single trajectory within the space of continuous functions, and systems chaotic on a strange attractor are analytically discoverable under a geometric condition on the attractor. As a consequence, we demonstrate for the first time that the classical Lorenz system is analytically discoverable. Moreover, we establish that analytic discoverability is impossible in the presence of first integrals, common in real-world systems. These findings help explain the success of data-driven methods in inherently chaotic domains like weather forecasting, while revealing a significant challenge for engineering applications like digital twins, where stable, predictable behavior is desired. For these non-chaotic systems, we find that while trajectory data alone is insufficient, certain prior physical knowledge can help ensure discoverability. These findings warrant a critical re-evaluation of the fundamental assumptions underpinning purely data-driven discovery.
format Preprint
id arxiv_https___arxiv_org_abs_2511_08860
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle When is a System Discoverable from Data? Discovery Requires Chaos
Shumaylov, Zakhar
Zaika, Peter
Scholl, Philipp
Kutyniok, Gitta
Horesh, Lior
Schönlieb, Carola-Bibiane
Dynamical Systems
Artificial Intelligence
Machine Learning
Numerical Analysis
Chaotic Dynamics
The deep learning revolution has spurred a rise in advances of using AI in sciences. Within physical sciences the main focus has been on discovery of dynamical systems from observational data. Yet the reliability of learned surrogates and symbolic models is often undermined by the fundamental problem of non-uniqueness. The resulting models may fit the available data perfectly, but lack genuine predictive power. This raises the question: under what conditions can the systems governing equations be uniquely identified from a finite set of observations? We show, counter-intuitively, that chaos, typically associated with unpredictability, is crucial for ensuring a system is discoverable in the space of continuous or analytic functions. The prevalence of chaotic systems in benchmark datasets may have inadvertently obscured this fundamental limitation. More concretely, we show that systems chaotic on their entire domain are discoverable from a single trajectory within the space of continuous functions, and systems chaotic on a strange attractor are analytically discoverable under a geometric condition on the attractor. As a consequence, we demonstrate for the first time that the classical Lorenz system is analytically discoverable. Moreover, we establish that analytic discoverability is impossible in the presence of first integrals, common in real-world systems. These findings help explain the success of data-driven methods in inherently chaotic domains like weather forecasting, while revealing a significant challenge for engineering applications like digital twins, where stable, predictable behavior is desired. For these non-chaotic systems, we find that while trajectory data alone is insufficient, certain prior physical knowledge can help ensure discoverability. These findings warrant a critical re-evaluation of the fundamental assumptions underpinning purely data-driven discovery.
title When is a System Discoverable from Data? Discovery Requires Chaos
topic Dynamical Systems
Artificial Intelligence
Machine Learning
Numerical Analysis
Chaotic Dynamics
url https://arxiv.org/abs/2511.08860