Real-time forecasting of chaotic dynamics from sparse data and autoencoders
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911379871498240 |
|---|---|
| author | Özalp, Elise Nóvoa, Andrea Magri, Luca |
| author_facet | Özalp, Elise Nóvoa, Andrea Magri, Luca |
| contents | The real-time prediction of chaotic systems requires a nonlinear-reduced order model (ROM) to forecast the dynamics, and a stream of data from sensors to update the ROM. Data-driven ROMs are typically built with a two-step strategy: data compression in a lower-dimensional latent space, and prediction of the temporal dynamics on it. To achieve real-time prediction, however, there are two challenges to overcome: (i) ROMs of chaotic systems can become numerically unstable; and (ii) sensors' data are sparse, i.e., partial, and noisy. To overcome these challenges, we propose a three-step strategy: (i) a convolutional autoencoder (CAE) compresses the system's state onto a lower-dimensional latent space; (ii) a latent ROM (echo state network, ESN), which is formulated as a state-space model, predicts the temporal evolution on the latent space; and (iii) sequential data assimilation based on the Ensemble Kalman filter (EnKF) adaptively corrects the latent ROM by assimilating noisy and sparse measurements. This provides a numerically stable method (DA-CAE-ESN), which corrects itself every time that data becomes available from sensors. The DA-CAE-ESN is tested on spatio-temporally chaotic partial differential equations: the Kuramoto-Sivashinsky equation, and a two-dimensional Navier-Stokes equation (Kolmogorov flow). We show that the method provides accurate and stable forecasts across different levels of noise, sparsity, and sampling rates. As a by-product, the DA-CAE-ESN acts as a localization strategy that mitigates spurious correlations, which arise when applying the EnKF to high-dimensional systems. The DA-CAE-ESN provides a numerically stable method to perform real-time predictions, which opens opportunities for deploying data-driven latent models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_08729 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Real-time forecasting of chaotic dynamics from sparse data and autoencoders Özalp, Elise Nóvoa, Andrea Magri, Luca Chaotic Dynamics 37N10, 65P20 The real-time prediction of chaotic systems requires a nonlinear-reduced order model (ROM) to forecast the dynamics, and a stream of data from sensors to update the ROM. Data-driven ROMs are typically built with a two-step strategy: data compression in a lower-dimensional latent space, and prediction of the temporal dynamics on it. To achieve real-time prediction, however, there are two challenges to overcome: (i) ROMs of chaotic systems can become numerically unstable; and (ii) sensors' data are sparse, i.e., partial, and noisy. To overcome these challenges, we propose a three-step strategy: (i) a convolutional autoencoder (CAE) compresses the system's state onto a lower-dimensional latent space; (ii) a latent ROM (echo state network, ESN), which is formulated as a state-space model, predicts the temporal evolution on the latent space; and (iii) sequential data assimilation based on the Ensemble Kalman filter (EnKF) adaptively corrects the latent ROM by assimilating noisy and sparse measurements. This provides a numerically stable method (DA-CAE-ESN), which corrects itself every time that data becomes available from sensors. The DA-CAE-ESN is tested on spatio-temporally chaotic partial differential equations: the Kuramoto-Sivashinsky equation, and a two-dimensional Navier-Stokes equation (Kolmogorov flow). We show that the method provides accurate and stable forecasts across different levels of noise, sparsity, and sampling rates. As a by-product, the DA-CAE-ESN acts as a localization strategy that mitigates spurious correlations, which arise when applying the EnKF to high-dimensional systems. The DA-CAE-ESN provides a numerically stable method to perform real-time predictions, which opens opportunities for deploying data-driven latent models. |
| title | Real-time forecasting of chaotic dynamics from sparse data and autoencoders |
| topic | Chaotic Dynamics 37N10, 65P20 |
| url | https://arxiv.org/abs/2508.08729 |