Copertina

Partial information decomposition: redundancy as information bottleneck

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autore principale:	Kolchinsky, Artemy
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Information Theory Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Which bits went where? Past and future transfer entropy decomposition with the information bottleneck
di: Murphy, Kieran A., et al.
Pubblicazione: (2024)

Generalized Zurek's bound on the cost of an individual classical or quantum computation
di: Kolchinsky, Artemy
Pubblicazione: (2023)

Towards understanding neural collapse in supervised contrastive learning with the information bottleneck method
di: Wang, Siwei, et al.
Pubblicazione: (2023)

Machine-learning optimized measurements of chaotic dynamical systems via the information bottleneck
di: Murphy, Kieran A., et al.
Pubblicazione: (2023)

Generalized free energy and excess/housekeeping decomposition in nonequilibrium systems: from large deviations to thermodynamic speed limits
di: Kolchinsky, Artemy, et al.
Pubblicazione: (2024)

Data efficiency, dimensionality reduction, and the generalized symmetric information bottleneck
di: Martini, K. Michael, et al.
Pubblicazione: (2023)

WaterSIC: information-theoretically (near) optimal linear layer quantization
di: Lifar, Egor, et al.
Pubblicazione: (2026)

Sample efficient inductive matrix completion with noise and inexact side information
di: Yang, Yuepeng, et al.
Pubblicazione: (2026)

Shannon invariants: A scalable approach to information decomposition
di: Gutknecht, Aaron J., et al.
Pubblicazione: (2025)

An efficient search-and-score algorithm for ancestral graphs using multivariate information scores
di: Lagrange, Nikita, et al.
Pubblicazione: (2024)

Asymptotic evaluation of the information processing capacity in reservoir computing
di: Saito, Yohei
Pubblicazione: (2025)

Entropy-informed Decoding: Adaptive Information-Driven Branching
di: Evans, Benjamin Patrick, et al.
Pubblicazione: (2026)

Inferring entropy production in many-body systems using nonequilibrium maximum entropy
di: Aguilera, Miguel, et al.
Pubblicazione: (2025)

Approximating mutual information of high-dimensional variables using learned representations
di: Gowri, Gokul, et al.
Pubblicazione: (2024)

LZ Penalty: An information-theoretic repetition penalty for autoregressive language models
di: Ginart, Antonio A., et al.
Pubblicazione: (2025)

FAdam: Adam is a natural gradient optimizer using diagonal empirical Fisher information
di: Hwang, Dongseong
Pubblicazione: (2024)

Image selective encryption analysis using mutual information in CNN based embedding space
di: Messadi, Ikram, et al.
Pubblicazione: (2025)

Information-Theoretic Thresholds for the Alignments of Partially Correlated Graphs
di: Huang, Dong, et al.
Pubblicazione: (2024)

Physics-informed deep learning and compressive collocation for high-dimensional diffusion-reaction equations: practical existence theory and numerics
di: Brugiapaglia, Simone, et al.
Pubblicazione: (2024)

What should a neuron aim for? Designing local objective functions based on information theory
di: Schneider, Andreas C., et al.
Pubblicazione: (2024)

A physics-informed neural network framework for modeling obstacle-related equations
di: Bahja, Hamid El, et al.
Pubblicazione: (2023)

Thermodynamic dissipation does not bound replicator growth and decay rates
di: Kolchinsky, Artemy
Pubblicazione: (2024)

Elementary derivation of the dissipation--coherence bound for stochastic oscillators
di: Kolchinsky, Artemy
Pubblicazione: (2025)

Thermodynamics of Darwinian selection in molecular replicators
di: Kolchinsky, Artemy
Pubblicazione: (2021)

Intuitive dissection of the Gaussian information bottleneck method with an application to optimal prediction
di: Galstyan, Vahe, et al.
Pubblicazione: (2025)

Partial Information Decomposition for Data Interpretability and Feature Selection
di: Westphal, Charles, et al.
Pubblicazione: (2024)

Quantum Fisher information matrices from Rényi relative entropies
di: Wilde, Mark M.
Pubblicazione: (2025)

The Fast Möbius Transform: An algebraic approach to information decomposition
di: Jansma, Abel, et al.
Pubblicazione: (2024)

Orders between channels and implications for partial information decomposition
di: Gomes, André F. C., et al.
Pubblicazione: (2023)

Total/dual correlation/coherence, redundancy/synergy, complexity, and O-information for real and complex valued multivariate data
di: Pascual-Marqui, Roberto D., et al.
Pubblicazione: (2025)

Broadcast Channel Cooperative Gain: An Operational Interpretation of Partial Information Decomposition
di: Tian, Chao, et al.
Pubblicazione: (2025)

A Unified View of Group Fairness Tradeoffs Using Partial Information Decomposition
di: Hamman, Faisal, et al.
Pubblicazione: (2024)

Null models for comparing information decomposition across complex systems
di: Liardi, Alberto, et al.
Pubblicazione: (2024)

Understanding Transformer Architecture through Continuous Dynamics: A Partial Differential Equation Perspective
di: Zhang, Yukun, et al.
Pubblicazione: (2024)

Finite Memory Belief Approximation for Optimal Control in Partially Observable Markov Decision Processes
di: Kim, Mintae
Pubblicazione: (2026)

Demystifying Local and Global Fairness Trade-offs in Federated Learning Using Partial Information Decomposition
di: Hamman, Faisal, et al.
Pubblicazione: (2023)

Metabolism, information, and viability in a simulated physically-plausible protocell
di: Thomsen, Kristoffer R., et al.
Pubblicazione: (2024)

Training deep physical neural networks with local physical information bottleneck
di: Wang, Hao, et al.
Pubblicazione: (2026)

Ontology-driven personalized information retrieval for XML documents
di: Iddir, Ounnaci, et al.
Pubblicazione: (2026)

Heterogeneous co-occurrence embedding for visual information exploration
di: Ishida, Takuro, et al.
Pubblicazione: (2025)