Enregistré dans:
Détails bibliographiques
Auteurs principaux: Liardi, Alberto, Blackburne, George, Rajpal, Hardik, Rosas, Fernando E., Mediano, Pedro A. M.
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:https://arxiv.org/abs/2506.18498
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866918438613549056
author Liardi, Alberto
Blackburne, George
Rajpal, Hardik
Rosas, Fernando E.
Mediano, Pedro A. M.
author_facet Liardi, Alberto
Blackburne, George
Rajpal, Hardik
Rosas, Fernando E.
Mediano, Pedro A. M.
contents Our understanding of complex systems rests on our ability to characterise how they perform distributed computation and integrate information. Advances in information theory have introduced several quantities to describe complex information structures, where collective patterns of coordination emerge from higher-order (i.e. beyond-pairwise) interdependencies. Unfortunately, the use of these approaches to study large complex systems is severely hindered by the poor scalability of existing techniques. Moreover, there are relatively few measures specifically designed for multivariate time series data. Here we introduce a novel measure of information about macroscopic structures, termed M-information, which quantifies the higher-order integration of information in complex dynamical systems. We show that M-information can be calculated via a convex optimisation problem, and we derive a robust and efficient algorithm that scales gracefully with system size. Our analyses show that M-information is resilient to noise, indexes critical behaviour in artificial neuronal populations, and reflects states of consciousness and task performance in real-world macaque and mouse neuroimaging data. Furthermore, M-information can be incorporated into existing information decomposition frameworks to reveal a comprehensive taxonomy of information dynamics. Taken together, these results help us unravel collective computation in large complex systems.
format Preprint
id arxiv_https___arxiv_org_abs_2506_18498
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A scalable estimator of higher-order information in complex dynamical systems
Liardi, Alberto
Blackburne, George
Rajpal, Hardik
Rosas, Fernando E.
Mediano, Pedro A. M.
Information Theory
Our understanding of complex systems rests on our ability to characterise how they perform distributed computation and integrate information. Advances in information theory have introduced several quantities to describe complex information structures, where collective patterns of coordination emerge from higher-order (i.e. beyond-pairwise) interdependencies. Unfortunately, the use of these approaches to study large complex systems is severely hindered by the poor scalability of existing techniques. Moreover, there are relatively few measures specifically designed for multivariate time series data. Here we introduce a novel measure of information about macroscopic structures, termed M-information, which quantifies the higher-order integration of information in complex dynamical systems. We show that M-information can be calculated via a convex optimisation problem, and we derive a robust and efficient algorithm that scales gracefully with system size. Our analyses show that M-information is resilient to noise, indexes critical behaviour in artificial neuronal populations, and reflects states of consciousness and task performance in real-world macaque and mouse neuroimaging data. Furthermore, M-information can be incorporated into existing information decomposition frameworks to reveal a comprehensive taxonomy of information dynamics. Taken together, these results help us unravel collective computation in large complex systems.
title A scalable estimator of higher-order information in complex dynamical systems
topic Information Theory
url https://arxiv.org/abs/2506.18498