Stochastic dynamics learning with state-space systems

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ortega, Juan-Pablo, Rossmannek, Florian
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913124959911936
author Ortega, Juan-Pablo
Rossmannek, Florian
author_facet Ortega, Juan-Pablo
Rossmannek, Florian
contents This work advances the theoretical foundations of reservoir computing (RC) by providing a unified treatment of fading memory and the echo state property (ESP) in both deterministic and stochastic settings. We investigate state-space systems, a central model class in time series learning, and establish that fading memory and solution stability hold generically -- even in the absence of the ESP -- offering a robust explanation for the empirical success of RC models without strict contractivity conditions. In the stochastic case, we critically assess stochastic echo states, proposing a novel distributional perspective rooted in attractor dynamics on the space of probability distributions, which leads to a rich and coherent theory. Our results extend and generalize previous work on non-autonomous dynamical systems, offering new insights into causality, stability, and memory in RC models. This lays the groundwork for reliable generative modeling of temporal data in both deterministic and stochastic regimes.
format Preprint
id arxiv_https___arxiv_org_abs_2508_07876
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Stochastic dynamics learning with state-space systems
Ortega, Juan-Pablo
Rossmannek, Florian
Machine Learning
Dynamical Systems
Statistics Theory
37B02, 37B55, 37H05, 37N35, 62M10, 68T05
This work advances the theoretical foundations of reservoir computing (RC) by providing a unified treatment of fading memory and the echo state property (ESP) in both deterministic and stochastic settings. We investigate state-space systems, a central model class in time series learning, and establish that fading memory and solution stability hold generically -- even in the absence of the ESP -- offering a robust explanation for the empirical success of RC models without strict contractivity conditions. In the stochastic case, we critically assess stochastic echo states, proposing a novel distributional perspective rooted in attractor dynamics on the space of probability distributions, which leads to a rich and coherent theory. Our results extend and generalize previous work on non-autonomous dynamical systems, offering new insights into causality, stability, and memory in RC models. This lays the groundwork for reliable generative modeling of temporal data in both deterministic and stochastic regimes.
title Stochastic dynamics learning with state-space systems
topic Machine Learning
Dynamical Systems
Statistics Theory
37B02, 37B55, 37H05, 37N35, 62M10, 68T05
url https://arxiv.org/abs/2508.07876