Translating Measures onto Mechanisms: The Cognitive Relevance of Higher-Order Information

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Rebbin, D., Down, K. J. A., Varley, T. F., Ince, R., Canales-Johnson, A.
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912743092649984
author Rebbin, D.
Down, K. J. A.
Varley, T. F.
Ince, R.
Canales-Johnson, A.
author_facet Rebbin, D.
Down, K. J. A.
Varley, T. F.
Ince, R.
Canales-Johnson, A.
contents Higher-order information theory has become a rapidly growing toolkit in computational neuroscience, motivated by the idea that multivariate dependencies can reveal aspects of neural computation and communication that are invisible to pairwise analyses. Yet functional interpretations of synergy and redundancy often outpace principled arguments for how statistical quantities map onto mechanistic cognitive processes. Here we review the main families of higher-order measures with the explicit goal of translating mathematical properties into defensible mechanistic inferences. First, we systematize Shannon-based multivariate metrics and demonstrate that higher-order dependence is parsimoniously characterized by two largely independent axes: interaction strength and redundancy-synergy balance. We argue that balanced layering of synergistic integration and redundant broadcasting optimizes multiscale complexity, formalizing a computation-communication tradeoff. We then examine the partial information decomposition and outline pragmatic considerations for its deployment in neural data. Equipped with the relevant mathematical essentials, we connect redundancy-synergy balance to cognitive function by progressively embedding their mathematical properties in real-world constraints, starting with small synthetic systems before gradually building up to neuroimaging. We close by identifying key future directions for mechanistic insight: cross-scale bridging, intervention-based validation, and thermodynamically grounded unification of information dynamics.
format Preprint
id arxiv_https___arxiv_org_abs_2512_02671
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Translating Measures onto Mechanisms: The Cognitive Relevance of Higher-Order Information
Rebbin, D.
Down, K. J. A.
Varley, T. F.
Ince, R.
Canales-Johnson, A.
Neurons and Cognition
Higher-order information theory has become a rapidly growing toolkit in computational neuroscience, motivated by the idea that multivariate dependencies can reveal aspects of neural computation and communication that are invisible to pairwise analyses. Yet functional interpretations of synergy and redundancy often outpace principled arguments for how statistical quantities map onto mechanistic cognitive processes. Here we review the main families of higher-order measures with the explicit goal of translating mathematical properties into defensible mechanistic inferences. First, we systematize Shannon-based multivariate metrics and demonstrate that higher-order dependence is parsimoniously characterized by two largely independent axes: interaction strength and redundancy-synergy balance. We argue that balanced layering of synergistic integration and redundant broadcasting optimizes multiscale complexity, formalizing a computation-communication tradeoff. We then examine the partial information decomposition and outline pragmatic considerations for its deployment in neural data. Equipped with the relevant mathematical essentials, we connect redundancy-synergy balance to cognitive function by progressively embedding their mathematical properties in real-world constraints, starting with small synthetic systems before gradually building up to neuroimaging. We close by identifying key future directions for mechanistic insight: cross-scale bridging, intervention-based validation, and thermodynamically grounded unification of information dynamics.
title Translating Measures onto Mechanisms: The Cognitive Relevance of Higher-Order Information
topic Neurons and Cognition
url https://arxiv.org/abs/2512.02671