Cover Image

Information Bottleneck Analysis of Deep Neural Networks via Lossy Compression

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Butakov, Ivan, Tolmachev, Alexander, Malanchuk, Sofia, Neopryatnaya, Anna, Frolov, Alexey, Andreev, Kirill
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Information Theory 94A16 (Primary) 68T07, 94A17 (Secondary) E.4; H.1.1
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Efficient Distribution Matching of Representations via Noise-Injected Deep InfoMax
by: Butakov, Ivan, et al.
Published: (2024)

FMMI: Flow Matching Mutual Information Estimation
by: Butakov, Ivan, et al.
Published: (2025)

Curse of Slicing: Why Sliced Mutual Information is a Deceptive Measure of Statistical Dependence
by: Semenenko, Alexander, et al.
Published: (2025)

BrainIB++: Leveraging Graph Neural Networks and Information Bottleneck for Functional Brain Biomarkers in Schizophrenia
by: Hu, Tianzheng, et al.
Published: (2025)

REMEDI: Corrective Transformations for Improved Neural Entropy Estimation
by: Nilsson, Viktor, et al.
Published: (2024)

A Family of LZ78-based Universal Sequential Probability Assignments
by: Sagan, Naomi, et al.
Published: (2024)

Bandwidth-Efficient Multi-Agent Communication through Information Bottleneck and Vector Quantization
by: Farooq, Ahmad, et al.
Published: (2026)

The Geometric Mechanics of Contrastive Representation Learning: Alignment Potentials, Entropic Dispersion, and Cross-modal Divergence
by: Cai, Yichao, et al.
Published: (2026)

Hidden Coalitions in Multi-Agent AI: A Spectral Diagnostic from Internal Representations
by: Berg, Cameron, et al.
Published: (2026)

Approximating $f$-Divergences with Rank Statistics
by: Stein, Viktor, et al.
Published: (2026)

How Does Machine Learning Manage Complexity?
by: Fortnow, Lance
Published: (2026)

Compressive sensing inspired self-supervised single-pixel imaging
by: Lu, Jijun, et al.
Published: (2026)

A Game Theoretic Free Energy Analysis of Higher Order Synergy in Attention Heads of Large Language Models
by: Bouchaffra, Djamel
Published: (2026)

Supervised machine learning based signal demodulation in chaotic communications
by: Kozlenko, Mykola
Published: (2025)

When fractional quasi p-norms concentrate
by: Tyukin, Ivan Y., et al.
Published: (2025)

Adaptive Greedy Rejection Sampling
by: Flamich, Gergely, et al.
Published: (2023)

On Moment-Entropy inequalities in the space of matrices
by: Langharst, Dylan
Published: (2025)

VQToken: Neural Discrete Token Representation Learning for Extreme Token Reduction in Video Large Language Models
by: Zhang, Haichao, et al.
Published: (2025)

Applications of Entropy in Data Analysis and Machine Learning: A Review
by: Fontaine, Salomé A. Sepúveda, et al.
Published: (2025)

Smooth SCAD: A Raised Cosine SCAD Type Thresholding Rule for Wavelet Denoising
by: Kulkarni, Radhika, et al.
Published: (2026)

Composable Post-Quantum Security for FADEC-Coupled Dual-Spool Turbofan Cyber-Physical Systems
by: Alpay, Faruk, et al.
Published: (2026)

Software demodulation of weak radio signals using convolutional neural network
by: Kozlenko, Mykola, et al.
Published: (2025)

Structural Properties of Entropic Vectors and Stability of the Ingleton Inequality
by: Matveev, Rostislav, et al.
Published: (2025)

From Zipf's Law to Neural Scaling through Heaps' Law and Hilberg's Hypothesis
by: Dębowski, Łukasz
Published: (2025)

Denoising guarantees for optimized sampling schemes in compressed sensing
by: Plan, Yaniv, et al.
Published: (2025)

Greedy Poisson Rejection Sampling
by: Flamich, Gergely
Published: (2023)

On nonlinear compression costs: when Shannon meets Rényi
by: Somazzi, Andrea, et al.
Published: (2023)

A Deep Learning Approach to Multipath Component Detection in Power Delay Profiles
by: Zeleny, Ondrej, et al.
Published: (2026)

Entropy Moduli and Support-Sensitive BKM Coercivity for Rank-Deficient Non-Commutative Markov Semigroups
by: Nasreddine, Hassan
Published: (2026)

ViPer NL-COMM: Making Vector Perturbation Precoding Practical
by: Thomas, Thomas James, et al.
Published: (2026)

Learning pseudo-contractive denoisers for inverse problems
by: Wei, Deliang, et al.
Published: (2024)

Enhanced Rényi Entropy-Based Post-Quantum Key Agreement with Provable Security and Information-Theoretic Guarantees
by: Xu, Ruopengyu, et al.
Published: (2025)

Active Learning for Conditional Generative Compressed Sensing
by: DeLise, Alexander, et al.
Published: (2026)

Probabilistic and nonlinear compressive sensing
by: Barth, Lukas Silvester, et al.
Published: (2025)

Stable and Convexified Information Bottleneck Optimization via Symbolic Continuation and Entropy-Regularized Trajectories
by: Alpay, Faruk
Published: (2025)

Secrecy Energy Efficiency Maximization in RIS-Aided Wireless Networks
by: Fotock, Robert Kuku, et al.
Published: (2024)

Conserved active information
by: Chen, Yanchen, et al.
Published: (2025)

From Letters to Words and Back: Invertible Coding of Stationary Measures
by: Dębowski, Łukasz
Published: (2024)

On the monotonicity of discrete entropy for log-concave random vectors on $\mathbb{Z}^d$
by: Fradelizi, Matthieu, et al.
Published: (2024)

Spiking Neural Networks for SAR Interferometric Phase Unwrapping: A Theoretical Framework for Energy-Efficient Processing
by: Bara, Marc
Published: (2025)