Imagen de Portada

MIST: Mutual Information Estimation Via Supervised Training

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Gritsai, German, Richards, Megan, Méloux, Maxime, Cho, Kyunghyun, Peyrard, Maxime
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Information Theory
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Meta-Statistical Learning: Supervised Learning of Statistical Estimators
por: Peyrard, Maxime, et al.
Publicado: (2025)

Mechanistic Interpretability as Statistical Estimation: A Variance Analysis
por: Méloux, Maxime, et al.
Publicado: (2025)

Everything, Everywhere, All at Once: Is Mechanistic Interpretability Identifiable?
por: Méloux, Maxime, et al.
Publicado: (2025)

Mutual Information Multinomial Estimation
por: Chen, Yanzhi, et al.
Publicado: (2024)

Mutual Information Estimation via Normalizing Flows
por: Butakov, Ivan, et al.
Publicado: (2024)

On the Properties and Estimation of Pointwise Mutual Information Profiles
por: Czyż, Paweł, et al.
Publicado: (2023)

A Neural Difference-of-Entropies Estimator for Mutual Information
por: Ni, Haoran, et al.
Publicado: (2025)

Estimating Conditional Mutual Information for Dynamic Feature Selection
por: Gadgil, Soham, et al.
Publicado: (2023)

Contrastive Predictive Coding Done Right for Mutual Information Estimation
por: Ryu, J. Jon, et al.
Publicado: (2025)

Structure Learning via Mutual Information
por: Nixon, Jeremy
Publicado: (2024)

Mutual Information Estimation via $f$-Divergence and Data Derangements
por: Letizia, Nunzio A., et al.
Publicado: (2023)

VBO-MI: A Fully Gradient-Based Bayesian Optimization Framework Using Variational Mutual Information Estimation
por: Mirkarimi, Farhad
Publicado: (2026)

Neural Estimation of Pairwise Mutual Information in Masked Discrete Sequence Models
por: Sharma, Jai, et al.
Publicado: (2026)

The Dead Salmons of AI Interpretability
por: Méloux, Maxime, et al.
Publicado: (2025)

Generalization in Federated Learning: A Conditional Mutual Information Framework
por: Wang, Ziqiao, et al.
Publicado: (2025)

Accurate Estimation of Mutual Information in High Dimensional Data
por: Abdelaleem, Eslam, et al.
Publicado: (2025)

Estimating Mutual Information between Time Series and Temporal Event Sequences Across Diverse Analysis Tasks
por: Hu, Haoji, et al.
Publicado: (2026)

Transformers Provably Learn Directed Acyclic Graphs via Kernel-Guided Mutual Information
por: Cheng, Yuan, et al.
Publicado: (2025)

Shapley-Based Data Valuation with Mutual Information: A Key to Modified K-Nearest Neighbors
por: Vahedifar, Mohammad Ali, et al.
Publicado: (2023)

Joint Constellation Shaping Using Gradient Descent Approach for MU-MIMO Broadcast Channel
por: Vaillant, Maxime, et al.
Publicado: (2024)

Characterizing Dependence of Samples along the Langevin Dynamics and Algorithms via Contraction of $Φ$-Mutual Information
por: Liang, Jiaming, et al.
Publicado: (2024)

Fast Mutual Information Computation for Large Binary Datasets
por: Falcao, Andre O.
Publicado: (2024)

TwinTURBO: Semi-Supervised Fine-Tuning of Foundation Models via Mutual Information Decompositions for Downstream Task and Latent Spaces
por: Quétant, Guillaume, et al.
Publicado: (2025)

On Causality in Domain Adaptation and Semi-Supervised Learning: an Information-Theoretic Analysis for Parametric Models
por: Wu, Xuetong, et al.
Publicado: (2022)

Decoupled Descent: Exact Test Error Tracking Via Approximate Message Passing
por: Lovig, Max
Publicado: (2026)

MIFair: A Mutual-Information Framework for Intersectionality and Multiclass Fairness
por: Monnier, Jeanne, et al.
Publicado: (2026)

ML-PWS: Estimating the Mutual Information Between Experimental Time Series Using Neural Networks
por: Reinhardt, Manuel, et al.
Publicado: (2025)

End-to-End Learning of Geometrical Shaping Maximizing Generalized Mutual Information
por: Gümüs, Kadir, et al.
Publicado: (2019)

The Generalization Error of Supervised Machine Learning Algorithms
por: Perlaza, Samir M., et al.
Publicado: (2024)

Generalizing Supervised Contrastive learning: A Projection Perspective
por: Jeong, Minoh, et al.
Publicado: (2025)

Amortized Vine Copulas for High-Dimensional Density and Information Estimation
por: Safaai, Houman
Publicado: (2026)

Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States
por: Wang, Ziqiao, et al.
Publicado: (2022)

GAI-Enabled Explainable Personalized Federated Semi-Supervised Learning
por: Peng, Yubo, et al.
Publicado: (2024)

$α$-Mutual Information: A Tunable Privacy Measure for Privacy Protection in Data Sharing
por: Asl, MirHamed Jafarzadeh, et al.
Publicado: (2023)

Robust Millimeter Beamforming via Self-Supervised Hybrid Deep Learning
por: Zhu, Fenghao, et al.
Publicado: (2023)

$L^1$ Estimation: On the Optimality of Linear Estimators
por: Barnes, Leighton P., et al.
Publicado: (2023)

Semi-Supervised Learning with Noisy Proxy Covariates: Generalization Bounds and Distribution Regression
por: Kim, Kwangho, et al.
Publicado: (2026)

Bayes Conditional Distribution Estimation for Knowledge Distillation Based on Conditional Mutual Information
por: Ye, Linfeng, et al.
Publicado: (2024)

Rate of Model Collapse in Recursive Training
por: Suresh, Ananda Theertha, et al.
Publicado: (2024)

Symbolic Autoencoding for Self-Supervised Sequence Learning
por: Amani, Mohammad Hossein, et al.
Publicado: (2024)