Cover Image

Masks Can Be Distracting: On Context Comprehension in Diffusion Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Piskorz, Julianna, Pinneri, Cristina, Correia, Alvaro, Alfarra, Motasem, Garrepalli, Risheek, Louizos, Christos
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Guarding the Meaning: Self-Supervised Training for Semantic Robustness in Guard Models
by: Pinneri, Cristina, et al.
Published: (2025)

Analyzing and Improving Chain-of-Thought Monitorability Through Information Theory
by: Anwar, Usman, et al.
Published: (2026)

Non-exchangeable Conformal Prediction with Optimal Transport: Tackling Distribution Shifts with Unlabeled Data
by: Correia, Alvaro H. C., et al.
Published: (2025)

MADI: Masking-Augmented Diffusion with Inference-Time Scaling for Visual Editing
by: Kadambi, Shreya, et al.
Published: (2025)

DDIL: Diversity Enhancing Diffusion Distillation With Imitation Learning
by: Garrepalli, Risheek, et al.
Published: (2024)

On Sampling Strategies for Spectral Model Sharding
by: Korzhenkov, Denis, et al.
Published: (2024)

Approximating Full Conformal Prediction for Neural Network Regression with Gauss-Newton Influence
by: Tailor, Dharmesh, et al.
Published: (2025)

A Comparative analysis of Layer-wise Representational Capacity in AR and Diffusion LLMs
by: Goel, Raghavv, et al.
Published: (2026)

Spiffy: Multiplying Diffusion LLM Acceleration via Lossless Speculative Decoding
by: Agrawal, Sudhanshu, et al.
Published: (2025)

An Information Theoretic Perspective on Conformal Prediction
by: Correia, Alvaro H. C., et al.
Published: (2024)

Towards Faster and More Compact Foundation Models for Molecular Property Prediction
by: Ghunaim, Yasir, et al.
Published: (2025)

SimCS: Simulation for Domain Incremental Online Continual Segmentation
by: Alfarra, Motasem, et al.
Published: (2022)

A Mutual Information Perspective on Federated Contrastive Learning
by: Louizos, Christos, et al.
Published: (2024)

Beyond the ATE: Interpretable Modelling of Treatment Effects over Dose and Time
by: Piskorz, Julianna, et al.
Published: (2025)

ConFu: Contemplate the Future for Better Speculative Sampling
by: Qin, Zongyue, et al.
Published: (2026)

Eliciting Numerical Predictive Distributions of LLMs Without Autoregression
by: Piskorz, Julianna, et al.
Published: (2026)

Fundamental bounds on efficiency-confidence trade-off for transductive conformal prediction
by: Behboodi, Arash, et al.
Published: (2025)

Stable Diffusion-based Data Augmentation for Federated Learning with Non-IID Data
by: Morafah, Mahdi, et al.
Published: (2024)

Variational Learning ISTA
by: Massoli, Fabio Valerio, et al.
Published: (2024)

Private PoEtry: Private In-Context Learning via Product of Experts
by: Romijnders, Rob, et al.
Published: (2026)

Towards Interpretable Deep Local Learning with Successive Gradient Reconciliation
by: Yang, Yibo, et al.
Published: (2024)

On Adaptivity in Zeroth-Order Optimization
by: Dbouk, Hassan, et al.
Published: (2026)

Forget Less, Retain More: A Lightweight Regularizer for Rehearsal-Based Continual Learning
by: Alssum, Lama, et al.
Published: (2025)

A Probabilistic Approach to Pose Synchronization for Multi-Reference Alignment with Applications to MIMO Wireless Communication Systems
by: Romijnders, Rob, et al.
Published: (2025)

Improving the Generation and Evaluation of Synthetic Data for Downstream Medical Causal Inference
by: Amad, Harry, et al.
Published: (2025)

Technical Report: Facilitating the Adoption of Causal Inference Methods Through LLM-Empowered Co-Pilot
by: Berrevoets, Jeroen, et al.
Published: (2025)

Online Distillation with Continual Learning for Cyclic Domain Shifts
by: Houyon, Joachim, et al.
Published: (2023)

Protect Your Score: Contact Tracing With Differential Privacy Guarantees
by: Romijnders, Rob, et al.
Published: (2023)

Context-Aware Quantitative Risk Assessment Machine Learning Model for Drivers Distraction
by: Fasanmade, Adebamigbe, et al.
Published: (2024)

Search or Accelerate: Confidence-Switched Position Beam Search for Diffusion Language Models
by: Cao, Mingyu, et al.
Published: (2026)

Backdooring Masked Diffusion Language Models
by: Cao, Daniel Yiming, et al.
Published: (2026)

DNA: Differentially private Neural Augmentation for contact tracing
by: Romijnders, Rob, et al.
Published: (2024)

InterroGate: Learning to Share, Specialize, and Prune Representations for Multi-task Learning
by: Bejnordi, Babak Ehteshami, et al.
Published: (2024)

Search-Augmented Masked Diffusion Models for Constrained Generation
by: Ta, Huu Binh, et al.
Published: (2026)

Scaling Beyond Masked Diffusion Language Models
by: Sahoo, Subham Sekhar, et al.
Published: (2026)

Diffusion-State Policy Optimization for Masked Diffusion Language Models
by: Oba, Daisuke, et al.
Published: (2026)

Soft-Masked Diffusion Language Models
by: Hersche, Michael, et al.
Published: (2025)

Evaluation of Test-Time Adaptation Under Computational Time Constraints
by: Alfarra, Motasem, et al.
Published: (2023)

Beyond RAG vs. Long-Context: Learning Distraction-Aware Retrieval for Efficient Knowledge Grounding
by: Shim, Seongwoong, et al.
Published: (2025)

MDPO: Overcoming the Training-Inference Divide of Masked Diffusion Language Models
by: He, Haoyu, et al.
Published: (2025)