:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Ebrahimi, M. Reza, Chen, Jun, Khisti, Ashish
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Information Theory
Online Access:	https://arxiv.org/abs/2410.21666
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Black-Box Detection of LLM-Generated Text Using Generalized Jensen-Shannon Divergence
by: Chen, Shuangyi, et al.
Published: (2025)

Channel Simulation and Distributed Compression with Ensemble Rejection Sampling
by: Phan, Buu, et al.
Published: (2025)

Rate-Distortion-Perception Tradeoff Based on the Conditional-Distribution Perception Measure
by: Salehkalaibar, Sadaf, et al.
Published: (2024)

Multi-Draft Speculative Sampling: Canonical Decomposition and Theoretical Limits
by: Khisti, Ashish, et al.
Published: (2024)

On Self-Adaptive Perception Loss Function for Sequential Lossy Compression
by: Salehkalaibar, Sadaf, et al.
Published: (2025)

Cross-Domain Lossy Compression via Constrained Minimum Entropy Coupling
by: Nguyen, Nam, et al.
Published: (2026)

Breaking the Finite-Sample Barrier in Entropy Coupling
by: Asoodeh, Shahab, et al.
Published: (2026)

Multi-Marginal Couplings for Metropolis-Hastings
by: Phan, Buu, et al.
Published: (2026)

An Analysis of Minimum Error Entropy Loss Functions in Wireless Communications
by: Pallewela, Rumeshika, et al.
Published: (2024)

Importance Matching Lemma for Lossy Compression with Side Information
by: Phan, Buu, et al.
Published: (2024)

One-Shot Broadcast Joint Source-Channel Coding with Codebook Diversity
by: Rowan, Joseph, et al.
Published: (2026)

Projection Head is Secretly an Information Bottleneck
by: Ouyang, Zhuo, et al.
Published: (2025)

The Alignment Bottleneck
by: Cao, Wenjun
Published: (2025)

Gaussian Rate-Distortion-Perception Coding and Entropy-Constrained Scalar Quantization
by: Xie, Li, et al.
Published: (2024)

Bottlenecked Transformers: Periodic KV Cache Consolidation for Generalised Reasoning
by: Oomerjee, Adnan, et al.
Published: (2025)

Cauchy-Schwarz Divergence Information Bottleneck for Regression
by: Yu, Shujian, et al.
Published: (2024)

Coupled Entropy: A Goldilocks Generalization for Complex Systems
by: Nelson, Kenric P.
Published: (2025)

Tackling Distribution Shifts in Task-Oriented Communication with Information Bottleneck
by: Li, Hongru, et al.
Published: (2024)

Differentiable Information Bottleneck for Deterministic Multi-view Clustering
by: Yan, Xiaoqiang, et al.
Published: (2024)

List-Level Distribution Coupling with Applications to Speculative Decoding and Lossy Compression
by: Rowan, Joseph, et al.
Published: (2025)

A Generalized Information Bottleneck Theory of Deep Learning
by: Westphal, Charles, et al.
Published: (2025)

Statistically Valid Information Bottleneck via Multiple Hypothesis Testing
by: Farzaneh, Amirmohammad, et al.
Published: (2024)

Structured IB: Improving Information Bottleneck with Structured Feature Learning
by: Yang, Hanzhe, et al.
Published: (2024)

Minimum Description Length and Generalization Guarantees for Representation Learning
by: Sefidgaran, Milad, et al.
Published: (2024)

OVA-IB: One vs All Information Bottleneck for Multi-Modal Alignment
by: Li, Tianchao, et al.
Published: (2026)

Distributed Information Bottleneck Theory for Multi-Modal Task-Aware Semantic Communication
by: Zhou, Yujie, et al.
Published: (2025)

Indexed Minimum Empirical Divergence-Based Algorithms for Linear Bandits
by: Bian, Jie, et al.
Published: (2024)

Breaking AR's Sampling Bottleneck: Provable Acceleration via Diffusion Language Models
by: Li, Gen, et al.
Published: (2025)

Information Compression in the AI Era: Recent Advances and Future Challenges
by: Chen, Jun, et al.
Published: (2024)

Subset Adaptive Relaying for Streaming Erasure Codes
by: Kaleem, Muhammad Ahmad, et al.
Published: (2024)

Bounds on the Excess Minimum Risk via Generalized Information Divergence Measures
by: Omanwar, Ananya, et al.
Published: (2025)

A Theory of Machine Understanding via the Minimum Description Length Principle
by: Zhang, Canlin, et al.
Published: (2025)

Batches Stabilize the Minimum Norm Risk in High Dimensional Overparameterized Linear Regression
by: Ioushua, Shahar Stein, et al.
Published: (2023)

Empirical Risk Minimization with Relative Entropy Regularization
by: Perlaza, Samir M., et al.
Published: (2022)

The Causal Information Bottleneck and Optimal Causal Variable Abstractions
by: Simoes, Francisco N. F. Q., et al.
Published: (2024)

Asymmetry of the Relative Entropy in the Regularization of Empirical Risk Minimization
by: Daunas, Francisco, et al.
Published: (2024)

Fundamental limits of distributed covariance matrix estimation via a conditional strong data processing inequality
by: Rahmani, Mohammad Reza, et al.
Published: (2025)

Sparse In-Network Learning via Shortest-Path Backpropagation and Finite-Rate Gating
by: Salehi, Mohammad Reza Deylam
Published: (2026)

TREET: TRansfer Entropy Estimation via Transformers
by: Luxembourg, Omer, et al.
Published: (2024)

Transfer Entropy in Graph Convolutional Neural Networks
by: Moldovan, Adrian, et al.
Published: (2024)