Cover Image

Contrastive Predictive Coding Done Right for Mutual Information Estimation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ryu, J. Jon, Yeddanapudi, Pavan, Xu, Xiangxiang, Wornell, Gregory W.
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Unified View on Learning Unnormalized Distributions via Noise-Contrastive Estimation
by: Ryu, J. Jon, et al.
Published: (2024)

Gambling-Based Confidence Sequences for Bounded Random Vectors
by: Ryu, J. Jon, et al.
Published: (2024)

Mutual Information Multinomial Estimation
by: Chen, Yanzhi, et al.
Published: (2024)

Separable Computation of Information Measures
by: Xu, Xiangxiang, et al.
Published: (2025)

Mutual Information Estimation via Normalizing Flows
by: Butakov, Ivan, et al.
Published: (2024)

On the Properties and Estimation of Pointwise Mutual Information Profiles
by: Czyż, Paweł, et al.
Published: (2023)

A Neural Difference-of-Entropies Estimator for Mutual Information
by: Ni, Haoran, et al.
Published: (2025)

MIST: Mutual Information Estimation Via Supervised Training
by: Gritsai, German, et al.
Published: (2025)

Estimating Conditional Mutual Information for Dynamic Feature Selection
by: Gadgil, Soham, et al.
Published: (2023)

Score-of-Mixture Training: Training One-Step Generative Models Made Simple via Score Estimation of Mixture Distributions
by: Jayashankar, Tejas, et al.
Published: (2025)

Structure Learning via Mutual Information
by: Nixon, Jeremy
Published: (2024)

Mutual Information Estimation via $f$-Divergence and Data Derangements
by: Letizia, Nunzio A., et al.
Published: (2023)

Revisiting Orbital Minimization Method for Neural Operator Decomposition
by: Ryu, J. Jon, et al.
Published: (2025)

VBO-MI: A Fully Gradient-Based Bayesian Optimization Framework Using Variational Mutual Information Estimation
by: Mirkarimi, Farhad
Published: (2026)

Neural Estimation of Pairwise Mutual Information in Masked Discrete Sequence Models
by: Sharma, Jai, et al.
Published: (2026)

Improved Offline Contextual Bandits with Second-Order Bounds: Betting and Freezing
by: Ryu, J. Jon, et al.
Published: (2025)

Generalization in Federated Learning: A Conditional Mutual Information Framework
by: Wang, Ziqiao, et al.
Published: (2025)

Accurate Estimation of Mutual Information in High Dimensional Data
by: Abdelaleem, Eslam, et al.
Published: (2025)

Operator SVD with Neural Networks via Nested Low-Rank Approximation
by: Ryu, J. Jon, et al.
Published: (2024)

Minimax Optimal Algorithms with Fixed-$k$-Nearest Neighbors
by: Ryu, J. Jon, et al.
Published: (2022)

Estimating Mutual Information between Time Series and Temporal Event Sequences Across Diverse Analysis Tasks
by: Hu, Haoji, et al.
Published: (2026)

Transformers Provably Learn Directed Acyclic Graphs via Kernel-Guided Mutual Information
by: Cheng, Yuan, et al.
Published: (2025)

Shapley-Based Data Valuation with Mutual Information: A Key to Modified K-Nearest Neighbors
by: Vahedifar, Mohammad Ali, et al.
Published: (2023)

Characterizing Dependence of Samples along the Langevin Dynamics and Algorithms via Contraction of $Φ$-Mutual Information
by: Liang, Jiaming, et al.
Published: (2024)

Fast Mutual Information Computation for Large Binary Datasets
by: Falcao, Andre O.
Published: (2024)

Statistical Mean Estimation with Coded Relayed Observations
by: Ling, Yan Hao, et al.
Published: (2025)

Contrastive ECOC: Learning Output Codes for Adversarial Defense
by: Chou, Che-Yu, et al.
Published: (2025)

Neural Estimation of the Rate-Distortion Function With Applications to Operational Source Coding
by: Lei, Eric, et al.
Published: (2022)

Learning to Reconfigure: Using Device Status to Select the Right Constrained Coding Scheme
by: Özbayrak, Doğukan, et al.
Published: (2025)

Predictability Analysis of Regression Problems via Conditional Entropy Estimations
by: Fang, Yu-Hsueh, et al.
Published: (2024)

An Information Theoretic Perspective on Conformal Prediction
by: Correia, Alvaro H. C., et al.
Published: (2024)

Learning Short Codes for Fading Channels with No or Receiver-Only Channel State Information
by: Pomaje, Rishabh Sharad, et al.
Published: (2024)

Efficient Parametric SVD of Koopman Operator for Stochastic Dynamical Systems
by: Jeong, Minchan, et al.
Published: (2025)

MIFair: A Mutual-Information Framework for Intersectionality and Multiclass Fairness
by: Monnier, Jeanne, et al.
Published: (2026)

ML-PWS: Estimating the Mutual Information Between Experimental Time Series Using Neural Networks
by: Reinhardt, Manuel, et al.
Published: (2025)

Unified Error Correction Code Transformer with Low Complexity
by: Yan, Yongli, et al.
Published: (2024)

DoDo-Code: an Efficient Levenshtein Distance Embedding-based Code for 4-ary IDS Channel
by: Guo, Alan J. X., et al.
Published: (2023)

End-to-End Learning of Geometrical Shaping Maximizing Generalized Mutual Information
by: Gümüs, Kadir, et al.
Published: (2019)

Forecastability as an Information-Theoretic Limit on Prediction
by: Catt, Peter Maurice
Published: (2026)

Generalizing Supervised Contrastive learning: A Projection Perspective
by: Jeong, Minoh, et al.
Published: (2025)