Cover Image

MMG: Mutual Information Estimation via the MMSE Gap in Diffusion

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yu, Longxuan, Shi, Xing, Kong, Xianghao, Jia, Tong, Steeg, Greg Ver
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Interpretable Diffusion via Information Decomposition
by: Kong, Xianghao, et al.
Published: (2023)

Is Your Diffusion Sampler Actually Correct? A Sampler-Centric Evaluation of Discrete Diffusion Language Models
by: Tang, Luhan, et al.
Published: (2026)

Generation Order and Parallel Decoding in Masked Diffusion Models: An Information-Theoretic Perspective
by: Zhang, Shaorong, et al.
Published: (2026)

Your Diffusion Model is Secretly a Noise Classifier and Benefits from Contrastive Training
by: Wu, Yunshu, et al.
Published: (2024)

AbFlowNet: Optimizing Antibody-Antigen Binding Energy via Diffusion-GFlowNet Fusion
by: Abir, Abrar Rahman, et al.
Published: (2025)

Asymmetric Bias in Text-to-Image Generation with Adversarial Attacks
by: Shahgir, Haz Sameen, et al.
Published: (2023)

Improving Mutual Information Estimation with Annealed and Energy-Based Bounds
by: Brekelmans, Rob, et al.
Published: (2023)

Thinking Out of Order: When Output Order Stops Reflecting Reasoning Order in Diffusion Language Models
by: Yu, Longxuan, et al.
Published: (2026)

Exploring the Design Space of Diffusion Bridge Models
by: Zhang, Shaorong, et al.
Published: (2024)

Local MAP Sampling for Diffusion Models
by: Zhang, Shaorong, et al.
Published: (2025)

DSL-LLaDA: Scaling Continuous Denoising to 8B Masked Diffusion LMs
by: Yu, Longxuan, et al.
Published: (2026)

Diverse Policies Recovering via Pointwise Mutual Information Weighted Imitation Learning
by: Yang, Hanlin, et al.
Published: (2024)

Discrete Stochastic Localization for Non-autoregressive Generation
by: Wu, Yunshu, et al.
Published: (2026)

Task-guided Spatiotemporal Network with Diffusion Augmentation for EEG-based Dementia Diagnosis and MMSE Prediction
by: Zheng, Xiaoyu, et al.
Published: (2026)

Discrete Stochastic Localization for Non-autoregressive Generation
by: Wu, Yunshu, et al.
Published: (2026)

Anti-Self-Distillation for Reasoning RL via Pointwise Mutual Information
by: Shen, Guobin, et al.
Published: (2026)

Making Sense Of Distributed Representations With Activation Spectroscopy
by: Reing, Kyle, et al.
Published: (2025)

Attention-Aided MMSE for OFDM Channel Estimation: Learning Linear Filters with Attention
by: Ha, TaeJun, et al.
Published: (2025)

MMG2Skill: Can Agents Distill In-the-Wild Guides into Self-Evolving Skills?
by: Che, Xinyu, et al.
Published: (2026)

A Benchmark Suite for Evaluating Neural Mutual Information Estimators on Unstructured Datasets
by: Lee, Kyungeun, et al.
Published: (2024)

Measurement-Aligned Sampling for Inverse Problem
by: Zhang, Shaorong, et al.
Published: (2025)

ESI: Epistemic Uncertainty Quantification via Semantic-preserving Intervention for Large Language Models
by: Li, Mingda, et al.
Published: (2025)

Stretching Each Dollar: Diffusion Training from Scratch on a Micro-Budget
by: Sehwag, Vikash, et al.
Published: (2024)

Spectral Regularization for Diffusion Models
by: Chandran, Satish, et al.
Published: (2026)

MOLE: MOdular Learning FramEwork via Mutual Information Maximization
by: Li, Tianchao, et al.
Published: (2023)

Estimating Mutual Information between Time Series and Temporal Event Sequences Across Diverse Analysis Tasks
by: Hu, Haoji, et al.
Published: (2026)

Neural Estimation of Pairwise Mutual Information in Masked Discrete Sequence Models
by: Sharma, Jai, et al.
Published: (2026)

KG-LLM-Bench: A Scalable Benchmark for Evaluating LLM Reasoning on Textualized Knowledge Graphs
by: Markowitz, Elan, et al.
Published: (2025)

Mutual Information Regularized Offline Reinforcement Learning
by: Ma, Xiao, et al.
Published: (2022)

Skill-aware Mutual Information Optimisation for Generalisation in Reinforcement Learning
by: Yu, Xuehui, et al.
Published: (2024)

Efficient Process Reward Modeling via Contrastive Mutual Information
by: Lee, Nakyung, et al.
Published: (2026)

Learning Morphisms with Gauss-Newton Approximation for Growing Networks
by: Lawton, Neal, et al.
Published: (2024)

Dynamic Correction of Erroneous State Estimates via Diffusion Bayesian Exploration
by: Shi, Yiwei, et al.
Published: (2025)

Robust Multi-Agent Reinforcement Learning by Mutual Information Regularization
by: Li, Simin, et al.
Published: (2023)

Federated Learning Framework via Distributed Mutual Learning
by: Gupta, Yash
Published: (2025)

Bridging Dynamics Gaps via Diffusion Schrödinger Bridge for Cross-Domain Reinforcement Learning
by: Zhang, Hanping, et al.
Published: (2026)

The Scaling Law for LoRA Base on Mutual Information Upper Bound
by: Zhang, Jing, et al.
Published: (2025)

Mutual-Taught for Co-adapting Policy and Reward Models
by: Shi, Tianyuan, et al.
Published: (2025)

Mutual Information Tracks Policy Coherence in Reinforcement Learning
by: Reid, Cameron, et al.
Published: (2025)

Fairness in Survival Analysis: A Novel Conditional Mutual Information Augmentation Approach
by: Xie, Tianyang, et al.
Published: (2025)