Cover Image

Accurate Estimation of Mutual Information in High Dimensional Data

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Abdelaleem, Eslam, Martini, K. Michael, Nemenman, Ilya
Format:	Preprint
Published:	2025
Subjects:	Data Analysis, Statistics and Probability Information Theory Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Losses
by: Abdelaleem, Eslam, et al.
Published: (2023)

Simultaneous Dimensionality Reduction: A Data Efficient Approach for Multimodal Representations Learning
by: Abdelaleem, Eslam, et al.
Published: (2023)

Information bottleneck for learning the phase space of dynamics from high-dimensional experimental data
by: Martini, K. Michael, et al.
Published: (2026)

Mutual information and task-relevant latent dimensionality
by: Gulati, Paarth, et al.
Published: (2026)

Data efficiency, dimensionality reduction, and the generalized symmetric information bottleneck
by: Martini, K. Michael, et al.
Published: (2023)

Simultaneous Dimensionality Reduction for Extracting Useful Representations of Large Empirical Multimodal Datasets
by: Abdelaleem, Eslam
Published: (2024)

Better Together: Cross and Joint Covariances Enhance Signal Detectability in Undersampled Data
by: Swain, Arabind, et al.
Published: (2025)

L$^2$M: Mutual Information Scaling Law for Long-Context Language Modeling
by: Chen, Zhuo, et al.
Published: (2025)

Surveying the space of descriptions of a composite system with machine learning
by: Murphy, Kieran A., et al.
Published: (2024)

Higher order definition of causality by optimally conditioned transfer entropy
by: Kořenek, Jakub, et al.
Published: (2024)

Contributions to Robust and Efficient Methods for Analysis of High Dimensional Data
by: Yang, Kai
Published: (2025)

Distribution of singular values in large sample cross-covariance matrices
by: Swain, Arabind, et al.
Published: (2025)

A Quantifiable Information-Processing Hierarchy Provides a Necessary Condition for Detecting Agency
by: Kagan, Brett J., et al.
Published: (2026)

Compression, Regularity, Randomness and Emergent Structure: Rethinking Physical Complexity in the Data-Driven Era
by: Dehghani, Nima
Published: (2025)

First-Extinction Law for Resampling Processes
by: Benati, Matteo, et al.
Published: (2025)

Data-Driven Extreme Response Estimation
by: Edwards, Samuel J., et al.
Published: (2025)

Information decomposition in complex systems via machine learning
by: Murphy, Kieran A., et al.
Published: (2023)

Statistical limits of correlation detection in trees
by: Ganassali, Luca, et al.
Published: (2022)

Intrinsic Signal Models Defined by the High-Dimensional, Small-Sample Limit
by: Mototake, Yoh-ichi, et al.
Published: (2023)

Probability Tools for Sequential Random Projection
by: Li, Yingru
Published: (2024)

Hybrid Summary Statistics
by: Makinen, T. Lucas, et al.
Published: (2024)

Characterising high-order interdependence via entropic conjugation
by: Rosas, Fernando E., et al.
Published: (2024)

A Thermodynamic Structure of Asymptotic Inference
by: Wong, Willy
Published: (2026)

High dimensional analysis reveals conservative sharpening and a stochastic edge of stability
by: Agarwala, Atish, et al.
Published: (2024)

Information-theoretic Quantification of High-order Feature Effects in Classification Problems
by: Lazic, Ivan, et al.
Published: (2025)

High-Dimensional Asymptotics of Differentially Private PCA
by: Yun, Youngjoo, et al.
Published: (2025)

Noise-Robust One-Bit Diffraction Tomography and Optimal Dose Fractionation
by: Chen, Pengwen, et al.
Published: (2023)

Trajectory analysis through entropy characterization over coded representation
by: Peña-Mendieta, Roxana, et al.
Published: (2024)

Physics-Aware, Shannon-Optimal Compression via Arithmetic Coding for Distributional Fidelity
by: Fanelli, Cristiano
Published: (2026)

A totally empirical basis of science
by: Loukas, Orestis, et al.
Published: (2024)

Comparative Analysis of Machine Learning-Based Imputation Techniques for Air Quality Datasets with High Missing Data Rates
by: Yan, Sen, et al.
Published: (2024)

Fisher information flow in artificial neural networks
by: Weimar, Maximilian, et al.
Published: (2025)

Mixed Noise and Posterior Estimation with Conditional DeepGEM
by: Hagemann, Paul, et al.
Published: (2024)

Model orthogonalization and Bayesian forecast mixing via Principal Component Analysis
by: Giuliani, Pablo, et al.
Published: (2024)

Message-Passing on Hypergraphs: Detectability, Phase Transitions and Higher-Order Information
by: Ruggeri, Nicolò, et al.
Published: (2023)

The Spectral Barycentre of a Set of Graphs with Community Structure
by: Meyer, François G.
Published: (2025)

Meta-learning optimizes predictions of missing links in real-world networks
by: Singh, Bisman, et al.
Published: (2025)

Bipartite mixed membership distribution-free model. A novel model for community detection in overlapping bipartite weighted networks
by: Qing, Huan, et al.
Published: (2022)

When does the mean network capture the topology of a sample of networks?
by: Meyer, François G
Published: (2024)

Flexible inference in heterogeneous and attributed multilayer networks
by: Contisciani, Martina, et al.
Published: (2024)