Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2410.11583 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929543752712192 |
|---|---|
| author | Liardi, Alberto Rosas, Fernando E. Carhart-Harris, Robin L. Blackburne, George Bor, Daniel Mediano, Pedro A. M. |
| author_facet | Liardi, Alberto Rosas, Fernando E. Carhart-Harris, Robin L. Blackburne, George Bor, Daniel Mediano, Pedro A. M. |
| contents | A key feature of information theory is its universality, as it can be applied to study a broad variety of complex systems. However, many information-theoretic measures can vary significantly even across systems with similar properties, making normalisation techniques essential for allowing meaningful comparisons across datasets. Inspired by the framework of Partial Information Decomposition (PID), here we introduce Null Models for Information Theory (NuMIT), a null model-based non-linear normalisation procedure which improves upon standard entropy-based normalisation approaches and overcomes their limitations. We provide practical implementations of the technique for systems with different statistics, and showcase the method on synthetic models and on human neuroimaging data. Our results demonstrate that NuMIT provides a robust and reliable tool to characterise complex systems of interest, allowing cross-dataset comparisons and providing a meaningful significance test for PID analyses. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_11583 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Null models for comparing information decomposition across complex systems Liardi, Alberto Rosas, Fernando E. Carhart-Harris, Robin L. Blackburne, George Bor, Daniel Mediano, Pedro A. M. Information Theory A key feature of information theory is its universality, as it can be applied to study a broad variety of complex systems. However, many information-theoretic measures can vary significantly even across systems with similar properties, making normalisation techniques essential for allowing meaningful comparisons across datasets. Inspired by the framework of Partial Information Decomposition (PID), here we introduce Null Models for Information Theory (NuMIT), a null model-based non-linear normalisation procedure which improves upon standard entropy-based normalisation approaches and overcomes their limitations. We provide practical implementations of the technique for systems with different statistics, and showcase the method on synthetic models and on human neuroimaging data. Our results demonstrate that NuMIT provides a robust and reliable tool to characterise complex systems of interest, allowing cross-dataset comparisons and providing a meaningful significance test for PID analyses. |
| title | Null models for comparing information decomposition across complex systems |
| topic | Information Theory |
| url | https://arxiv.org/abs/2410.11583 |