:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Ouyang, Zhuo, Hu, Kaiwen, Zhang, Qi, Wang, Yifei, Wang, Yisen
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Information Theory
Online Access:	https://arxiv.org/abs/2503.00507
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Understanding the Role of Equivariance in Self-supervised Learning
by: Wang, Yifei, et al.
Published: (2024)

Distributed Information Bottleneck Theory for Multi-Modal Task-Aware Semantic Communication
by: Zhou, Yujie, et al.
Published: (2025)

Three-dimensional signal processing: a new approach in dynamical sampling via tensor products
by: Wang, Yisen, et al.
Published: (2025)

Cauchy-Schwarz Divergence Information Bottleneck for Regression
by: Yu, Shujian, et al.
Published: (2024)

GeoIB: Geometry-Aware Information Bottleneck via Statistical-Manifold Compression
by: Wang, Weiqi, et al.
Published: (2026)

A Generalized Information Bottleneck Theory of Deep Learning
by: Westphal, Charles, et al.
Published: (2025)

Differentiable Information Bottleneck for Deterministic Multi-view Clustering
by: Yan, Xiaoqiang, et al.
Published: (2024)

Statistically Valid Information Bottleneck via Multiple Hypothesis Testing
by: Farzaneh, Amirmohammad, et al.
Published: (2024)

Structured IB: Improving Information Bottleneck with Structured Feature Learning
by: Yang, Hanzhe, et al.
Published: (2024)

OVA-IB: One vs All Information Bottleneck for Multi-Modal Alignment
by: Li, Tianchao, et al.
Published: (2026)

Tackling Distribution Shifts in Task-Oriented Communication with Information Bottleneck
by: Li, Hongru, et al.
Published: (2024)

Enabling Deep Learning-based Physical-layer Secret Key Generation for FDD-OFDM Systems in Multi-Environments
by: Zhang, Xinwei, et al.
Published: (2022)

Minimum Entropy Coupling with Bottleneck
by: Ebrahimi, M. Reza, et al.
Published: (2024)

The Causal Information Bottleneck and Optimal Causal Variable Abstractions
by: Simoes, Francisco N. F. Q., et al.
Published: (2024)

CORE: Data Augmentation for Link Prediction via Information Bottleneck
by: Dong, Kaiwen, et al.
Published: (2024)

The Alignment Bottleneck
by: Cao, Wenjun
Published: (2025)

Bottlenecked Transformers: Periodic KV Cache Consolidation for Generalised Reasoning
by: Oomerjee, Adnan, et al.
Published: (2025)

Flexible Variational Information Bottleneck: Achieving Diverse Compression with a Single Training
by: Kudo, Sota, et al.
Published: (2024)

Latent Representation and Simulation of Markov Processes via Time-Lagged Information Bottleneck
by: Federici, Marco, et al.
Published: (2023)

Breaking AR's Sampling Bottleneck: Provable Acceleration via Diffusion Language Models
by: Li, Gen, et al.
Published: (2025)

VNDUQE: Information-Theoretic Novelty Detection using Deep Variational Information Bottleneck
by: Gondkar, Aryan, et al.
Published: (2026)

Variational Secret Common Randomness Extraction
by: Li, Xinyang, et al.
Published: (2025)

Neuromorphic Wireless Device-Edge Co-Inference via the Directed Information Bottleneck
by: Ke, Yuzhen, et al.
Published: (2024)

An Augmentation Overlap Theory of Contrastive Learning
by: Zhang, Qi, et al.
Published: (2025)

Provably Efficient Information-Directed Sampling Algorithms for Multi-Agent Reinforcement Learning
by: Zhang, Qiaosheng, et al.
Published: (2024)

Generalization Bounds via Conditional $f$-Information
by: Wang, Ziqiao, et al.
Published: (2024)

An Information-Theoretic Analysis of In-Context Learning
by: Jeon, Hong Jun, et al.
Published: (2024)

Generalized Derangetropy Functionals for Modeling Cyclical Information Flow
by: Ataei, Masoud, et al.
Published: (2025)

Model Merging by Output-Space Projection
by: Evans, Bethan, et al.
Published: (2026)

Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Losses
by: Abdelaleem, Eslam, et al.
Published: (2023)

CSRv2: Unlocking Ultra-Sparse Embeddings
by: Guo, Lixuan, et al.
Published: (2026)

Receiver-Centric Generative Semantic Communications
by: Liu, Xunze, et al.
Published: (2024)

Generalization in Federated Learning: A Conditional Mutual Information Framework
by: Wang, Ziqiao, et al.
Published: (2025)

Generalizing Supervised Contrastive learning: A Projection Perspective
by: Jeong, Minoh, et al.
Published: (2025)

OmniZip: Learning a Unified and Lightweight Lossless Compressor for Multi-Modal Data
by: Zhao, Yan, et al.
Published: (2026)

Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States
by: Wang, Ziqiao, et al.
Published: (2022)

On the Limits of Sparse Autoencoders: A Theoretical Framework and Reweighted Remedy
by: Cui, Jingyi, et al.
Published: (2025)

Tighter CMI-Based Generalization Bounds via Stochastic Projection and Quantization
by: Sefidgaran, Milad, et al.
Published: (2025)

Cyclic Group Projection for Enumerating Quasi-Cyclic Codes Trapping Sets
by: Usatyuk, Vasiliy, et al.
Published: (2024)

An Information-Theoretic Framework for Out-of-Distribution Generalization with Applications to Stochastic Gradient Langevin Dynamics
by: Liu, Wenliang, et al.
Published: (2024)