Cover Image

Improving Mutual Information Estimation with Annealed and Energy-Based Bounds

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Brekelmans, Rob, Huang, Sicong, Ghassemi, Marzyeh, Steeg, Greg Ver, Grosse, Roger, Makhzani, Alireza
Format:	Preprint
Published:	2023
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Probabilistic Inference in Language Models via Twisted Sequential Monte Carlo
by: Zhao, Stephen, et al.
Published: (2024)

Measurement-Aligned Sampling for Inverse Problem
by: Zhang, Shaorong, et al.
Published: (2025)

Annealed Importance Sampling with q-Paths
by: Brekelmans, Rob, et al.
Published: (2020)

Generation Order and Parallel Decoding in Masked Diffusion Models: An Information-Theoretic Perspective
by: Zhang, Shaorong, et al.
Published: (2026)

MMG: Mutual Information Estimation via the MMSE Gap in Diffusion
by: Yu, Longxuan, et al.
Published: (2025)

Measuring Stochastic Data Complexity with Boltzmann Influence Functions
by: Ng, Nathan, et al.
Published: (2024)

Local MAP Sampling for Diffusion Models
by: Zhang, Shaorong, et al.
Published: (2025)

Discrete Stochastic Localization for Non-autoregressive Generation
by: Wu, Yunshu, et al.
Published: (2026)

Variational Representations of Annealing Paths: Bregman Information under Monotonic Embedding
by: Brekelmans, Rob, et al.
Published: (2022)

Discrete Stochastic Localization for Non-autoregressive Generation
by: Wu, Yunshu, et al.
Published: (2026)

A Computational Framework for Solving Wasserstein Lagrangian Flows
by: Neklyudov, Kirill, et al.
Published: (2023)

Exploring the Design Space of Diffusion Bridge Models
by: Zhang, Shaorong, et al.
Published: (2024)

Making Sense Of Distributed Representations With Activation Spectroscopy
by: Reing, Kyle, et al.
Published: (2025)

Reducing the Probability of Undesirable Outputs in Language Models Using Probabilistic Inference
by: Zhao, Stephen, et al.
Published: (2025)

Is Your Diffusion Sampler Actually Correct? A Sampler-Centric Evaluation of Discrete Diffusion Language Models
by: Tang, Luhan, et al.
Published: (2026)

Interpretable Diffusion via Information Decomposition
by: Kong, Xianghao, et al.
Published: (2023)

Learning Morphisms with Gauss-Newton Approximation for Growing Networks
by: Lawton, Neal, et al.
Published: (2024)

Asymmetric Bias in Text-to-Image Generation with Adversarial Attacks
by: Shahgir, Haz Sameen, et al.
Published: (2023)

Random Cycle Coding: Lossless Compression of Cluster Assignments via Bits-Back Coding
by: Severo, Daniel, et al.
Published: (2024)

Your Diffusion Model is Secretly a Noise Classifier and Benefits from Contrastive Training
by: Wu, Yunshu, et al.
Published: (2024)

Views Can Be Deceiving: Improved SSL Through Feature Space Augmentation
by: Hamidieh, Kimia, et al.
Published: (2024)

Spectral Regularization for Diffusion Models
by: Chandran, Satish, et al.
Published: (2026)

MaskMedPaint: Masked Medical Image Inpainting with Diffusion Models for Mitigation of Spurious Correlations
by: Jin, Qixuan, et al.
Published: (2024)

FedDAPL: Toward Client-Private Generalization in Federated Learning
by: Loaliyan, Soroosh Safari, et al.
Published: (2025)

AbFlowNet: Optimizing Antibody-Antigen Binding Energy via Diffusion-GFlowNet Fusion
by: Abir, Abrar Rahman, et al.
Published: (2025)

What's in a Query: Polarity-Aware Distribution-Based Fair Ranking
by: Balagopalan, Aparna, et al.
Published: (2025)

Feynman-Kac Correctors in Diffusion: Annealing, Guidance, and Product of Experts
by: Skreta, Marta, et al.
Published: (2025)

Data Debiasing with Datamodels (D3M): Improving Subgroup Robustness via Data Selection
by: Jain, Saachi, et al.
Published: (2024)

Knowledge Enhanced Multi-Domain Recommendations in an AI Assistant Application
by: Markowitz, Elan, et al.
Published: (2023)

Prompt Perturbation Consistency Learning for Robust Language Models
by: Qiang, Yao, et al.
Published: (2024)

Interpretable Measures of Conceptual Similarity by Complexity-Constrained Descriptive Auto-Encoding
by: Achille, Alessandro, et al.
Published: (2024)

An Investigation of Memorization Risk in Healthcare Foundation Models
by: Tonekaboni, Sana, et al.
Published: (2025)

Aggregation Hides Out-of-Distribution Generalization Failures from Spurious Correlations
by: Salaudeen, Olawale, et al.
Published: (2025)

Robustness Beyond Known Groups with Low-rank Adaptation
by: Gourabathina, Abinitha, et al.
Published: (2026)

Convergence of Statistical Estimators via Mutual Information Bounds
by: Khribch, El Mahdi, et al.
Published: (2024)

Event-Based Contrastive Learning for Medical Time Series
by: Jeong, Hyewon, et al.
Published: (2023)

Improving Black-box Robustness with In-Context Rewriting
by: O'Brien, Kyle, et al.
Published: (2024)

QuAILoRA: Quantization-Aware Initialization for LoRA
by: Lawton, Neal, et al.
Published: (2024)

In the Name of Fairness: Assessing the Bias in Clinical Record De-identification
by: Xiao, Yuxin, et al.
Published: (2023)

Speak Easy: Eliciting Harmful Jailbreaks from LLMs with Simple Interactions
by: Chan, Yik Siu, et al.
Published: (2025)