SVD-based Causal Emergence for Gaussian Iterative Systems

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Liu, Kaiwei, Pan, Linli, Wang, Zhipeng, Yang, Mingzhe, Yuan, Bing, Zhang, Jiang
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915633759780864
author Liu, Kaiwei
Pan, Linli
Wang, Zhipeng
Yang, Mingzhe
Yuan, Bing
Zhang, Jiang
author_facet Liu, Kaiwei
Pan, Linli
Wang, Zhipeng
Yang, Mingzhe
Yuan, Bing
Zhang, Jiang
contents Causal emergence (CE) based on effective information (EI) demonstrates that macro-states can exhibit stronger causal effects than micro-states in dynamics. However, the identification of CE and the maximization of EI both rely on coarse-graining strategies, which is a key challenge. A recently proposed CE framework based on approximate dynamical reversibility, utilizing singular value decomposition (SVD), is independent of coarse-graining. Still, it is limited to transition probability matrices (TPM) in discrete states. To address this, this article proposes a novel CE quantification framework for Gaussian iterative systems (GIS), based on approximate dynamical reversibility derived from the SVD of inverse covariance matrices in forward and backward dynamics. The positive correlation between SVD-based and EI-based CE, along with the equivalence condition, is given analytically. After that, we provide precise coarse-graining strategies directly from singular value spectra and orthogonal matrices. This new framework can be applied to any dynamical system with continuous states and Gaussian noise, such as auto-regressive growth models, Markov-Gaussian systems, and even SIR modeling using neural networks (NN). Numerical simulations on typical cases validate our theory and offer a new approach to studying the CE phenomenon, emphasizing noise and covariance over dynamical functions in both known models and machine learning.
format Preprint
id arxiv_https___arxiv_org_abs_2502_08261
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SVD-based Causal Emergence for Gaussian Iterative Systems
Liu, Kaiwei
Pan, Linli
Wang, Zhipeng
Yang, Mingzhe
Yuan, Bing
Zhang, Jiang
Chaotic Dynamics
Causal emergence (CE) based on effective information (EI) demonstrates that macro-states can exhibit stronger causal effects than micro-states in dynamics. However, the identification of CE and the maximization of EI both rely on coarse-graining strategies, which is a key challenge. A recently proposed CE framework based on approximate dynamical reversibility, utilizing singular value decomposition (SVD), is independent of coarse-graining. Still, it is limited to transition probability matrices (TPM) in discrete states. To address this, this article proposes a novel CE quantification framework for Gaussian iterative systems (GIS), based on approximate dynamical reversibility derived from the SVD of inverse covariance matrices in forward and backward dynamics. The positive correlation between SVD-based and EI-based CE, along with the equivalence condition, is given analytically. After that, we provide precise coarse-graining strategies directly from singular value spectra and orthogonal matrices. This new framework can be applied to any dynamical system with continuous states and Gaussian noise, such as auto-regressive growth models, Markov-Gaussian systems, and even SIR modeling using neural networks (NN). Numerical simulations on typical cases validate our theory and offer a new approach to studying the CE phenomenon, emphasizing noise and covariance over dynamical functions in both known models and machine learning.
title SVD-based Causal Emergence for Gaussian Iterative Systems
topic Chaotic Dynamics
url https://arxiv.org/abs/2502.08261