Cover Image

Data efficiency, dimensionality reduction, and the generalized symmetric information bottleneck

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Martini, K. Michael, Nemenman, Ilya
Format:	Preprint
Published:	2023
Subjects:	Information Theory Statistical Mechanics Machine Learning Data Analysis, Statistics and Probability
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Losses
by: Abdelaleem, Eslam, et al.
Published: (2023)

Accurate Estimation of Mutual Information in High Dimensional Data
by: Abdelaleem, Eslam, et al.
Published: (2025)

Information bottleneck for learning the phase space of dynamics from high-dimensional experimental data
by: Martini, K. Michael, et al.
Published: (2026)

Simultaneous Dimensionality Reduction: A Data Efficient Approach for Multimodal Representations Learning
by: Abdelaleem, Eslam, et al.
Published: (2023)

Mutual information and task-relevant latent dimensionality
by: Gulati, Paarth, et al.
Published: (2026)

Compression, Regularity, Randomness and Emergent Structure: Rethinking Physical Complexity in the Data-Driven Era
by: Dehghani, Nima
Published: (2025)

Bayesian symbolic regression: Automated equation discovery from a physicists' perspective
by: Guimera, Roger, et al.
Published: (2025)

Extrinsic vs Intrinsic Criticality in Systems with Many Components
by: Ngampruetikorn, Vudtiwat, et al.
Published: (2023)

A matrix form solution of the multi-dimensional generalized Langevin equation in the quadratic potential
by: Mushtaq, Rana Imran, et al.
Published: (2025)

Mutual information as a measure of mixing efficiency in viscous fluids
by: Shi, Yihong, et al.
Published: (2023)

Better Together: Cross and Joint Covariances Enhance Signal Detectability in Undersampled Data
by: Swain, Arabind, et al.
Published: (2025)

Distribution of singular values in large sample cross-covariance matrices
by: Swain, Arabind, et al.
Published: (2025)

Unsupervised learning of anomalous diffusion data
by: Muñoz-Gil, Gorka, et al.
Published: (2021)

An exact multiple-time-step variational formulation for the committor and the transition rate
by: Lorpaiboon, Chatipat, et al.
Published: (2025)

Hierarchical geometric deep learning enables scalable analysis of molecular dynamics
by: Pengmei, Zihan, et al.
Published: (2025)

Thermodynamic bounds on energy use in quasi-static Deep Neural Networks
by: Tkachenko, Alexei V.
Published: (2025)

Inference in conditioned dynamics through causality restoration
by: Braunstein, Alfredo, et al.
Published: (2022)

Deep learning of phase transitions with minimal examples
by: Abuali, Ahmed, et al.
Published: (2025)

Pointwise Generalization in Deep Neural Networks
by: Li, Shaojie, et al.
Published: (2026)

Surveying the space of descriptions of a composite system with machine learning
by: Murphy, Kieran A., et al.
Published: (2024)

Higher order definition of causality by optimally conditioned transfer entropy
by: Kořenek, Jakub, et al.
Published: (2024)

Functional Renormalization for Signal Detection: Dimensional Analysis and Dimensional Phase Transition for Nearly Continuous Spectra Effective Field Theory
by: Finotello, Riccardo, et al.
Published: (2025)

Entropy-based models to randomize real-world hypergraphs
by: Saracco, Fabio, et al.
Published: (2022)

Network Sampling: An Overview and Comparative Analysis
by: Nguyen, Quoc Chuong
Published: (2025)

Numerical Estimation of Limiting Large-Deviation Rate Functions
by: Werner, Peter, et al.
Published: (2024)

Diffusion with stochastic resetting on a lattice
by: Hartmann, Alexander K., et al.
Published: (2025)

Exact joint distributions of three global characteristic times for Brownian motion
by: Hartmann, Alexander K., et al.
Published: (2024)

First-Extinction Law for Resampling Processes
by: Benati, Matteo, et al.
Published: (2025)

When Stein-Type Test Detects Equilibrium Distributions of Finite N-Body Systems
by: Shim, Jae Wan
Published: (2026)

The Emergence of the Normal Distribution in Deterministic Chaotic Maps
by: Zanette, Damián H., et al.
Published: (2024)

Statistical limits of correlation detection in trees
by: Ganassali, Luca, et al.
Published: (2022)

Principled model selection for stochastic dynamics
by: Gerardos, Andonis, et al.
Published: (2025)

Description length of canonical and microcanonical models
by: Giuffrida, Francesca, et al.
Published: (2023)

Topological Kolmogorov complexity and the Berezinskii-Kosterlitz-Thouless mechanism
by: Vitale, Vittorio, et al.
Published: (2023)

A General Solution for Network Models with Pairwise Edge Coupling
by: Catanzaro, Alessio, et al.
Published: (2025)

Similarity networks of ordinal-pattern transitions classify falling paper trajectories
by: Flores, Angelo A., et al.
Published: (2025)

Feedback Driven Convergence, Competition, and Entanglement in Classical Stochastic Processes
by: Lobo, Allen, et al.
Published: (2025)

Martingale drift of Langevin dynamics and classical canonical spin statistics -- II
by: Sekimoto, Ken
Published: (2024)

Statistical Mechanical Analysis of Gaussian Processes
by: Tsuzurugi, Jun
Published: (2024)

Non-Normal Eigenvector Amplification in Multi-Dimensional Kesten Processes
by: Troude, Virgile, et al.
Published: (2025)