Cover Image

Soft-Masked Diffusion Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hersche, Michael, Moor-Smith, Samuel, Hofmann, Thomas, Rahimi, Abbas
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Locally Coherent Parallel Decoding in Diffusion Language Models
by: Hersche, Michael, et al.
Published: (2026)

On the Expressiveness and Length Generalization of Selective State-Space Models on Regular Languages
by: Terzić, Aleksandar, et al.
Published: (2024)

Limits of Transformer Language Models on Learning to Compose Algorithms
by: Thomm, Jonathan, et al.
Published: (2024)

Structured Sparse Transition Matrices to Enable State Tracking in State-Space Models
by: Terzić, Aleksandar, et al.
Published: (2025)

AgentRxiv: Towards Collaborative Autonomous Research
by: Schmidgall, Samuel, et al.
Published: (2025)

I-RAVEN-X: Benchmarking Generalization and Robustness of Analogical and Mathematical Reasoning in Large Language and Reasoning Models
by: Camposampiero, Giacomo, et al.
Published: (2025)

Probabilistic Abduction for Visual Abstract Reasoning via Learning Rules in Vector-symbolic Architectures
by: Hersche, Michael, et al.
Published: (2024)

Towards Learning to Reason: Comparing LLMs with Neuro-Symbolic on Arithmetic Relations in Abstract Reasoning
by: Hersche, Michael, et al.
Published: (2024)

On the Reasoning Abilities of Masked Diffusion Language Models
by: Svete, Anej, et al.
Published: (2025)

Simple and Effective Masked Diffusion Language Models
by: Sahoo, Subham Sekhar, et al.
Published: (2024)

On the Role of Noise in Factorizers for Disentangling Distributed Representations
by: Karunaratne, Geethan, et al.
Published: (2024)

Understanding and Accelerating the Training of Masked Diffusion Language Models
by: Hong, Chunsan, et al.
Published: (2026)

Scalable Evaluation and Neural Models for Compositional Generalization
by: Camposampiero, Giacomo, et al.
Published: (2025)

Can Large Reasoning Models do Analogical Reasoning under Perceptual Uncertainty?
by: Camposampiero, Giacomo, et al.
Published: (2025)

Flash PD-SSM: Memory-Optimized Structured Sparse State-Space Models
by: Terzić, Aleksandar, et al.
Published: (2026)

Variational Masked Diffusion Models
by: Zhang, Yichi, et al.
Published: (2025)

ILRR: Inference-Time Steering Method for Masked Diffusion Language Models
by: Avrahami, Eden, et al.
Published: (2026)

Towards Learning Abductive Reasoning using VSA Distributed Representations
by: Camposampiero, Giacomo, et al.
Published: (2024)

Terminating Differentiable Tree Experts
by: Thomm, Jonathan, et al.
Published: (2024)

A Theoretical Analysis of Test-Driven Code Generation
by: Menet, Nicolas, et al.
Published: (2026)

Masked Diffusion Models as Energy Minimization
by: Chen, Sitong, et al.
Published: (2025)

A foundation model with multi-variate parallel attention to generate neuronal activity
by: Carzaniga, Francesco, et al.
Published: (2025)

Thompson Sampling via Fine-Tuning of LLMs
by: Menet, Nicolas, et al.
Published: (2025)

Scaling up Masked Diffusion Models on Text
by: Nie, Shen, et al.
Published: (2024)

Mechanism Shift During Post-training from Autoregressive to Masked Diffusion Language Models
by: Kong, Injin, et al.
Published: (2026)

Parallelism and Generation Order in Masked Diffusion Language Models: Limits Today, Potential Tomorrow
by: Zhong, Yangyang, et al.
Published: (2026)

Beyond Masks: Efficient, Flexible Diffusion Language Models via Deletion-Insertion Processes
by: Ding, Fangyu, et al.
Published: (2026)

Masked Diffusion Models are Secretly Time-Agnostic Masked Models and Exploit Inaccurate Categorical Sampling
by: Zheng, Kaiwen, et al.
Published: (2024)

Adaptive Guidance for Retrieval-Augmented Masked Diffusion Models
by: Kim, Jaemin, et al.
Published: (2026)

Optimizing Decoding Paths in Masked Diffusion Models by Quantifying Uncertainty
by: Chen, Ziyu, et al.
Published: (2025)

Fisher Mask Nodes for Language Model Merging
by: K, Thennal D, et al.
Published: (2024)

Iterative Mask Filling: An Effective Text Augmentation Method Using Masked Language Modeling
by: Kesgin, Himmet Toprak, et al.
Published: (2024)

TABES: Trajectory-Aware Backward-on-Entropy Steering for Masked Diffusion Models
by: Saini, Shreshth, et al.
Published: (2026)

Boosting Large Language Models with Mask Fine-Tuning
by: Zhang, Mingyuan, et al.
Published: (2025)

Soft Prompting for Unlearning in Large Language Models
by: Bhaila, Karuna, et al.
Published: (2024)

Confidence Regularized Masked Language Modeling using Text Length
by: Ji, Seunghyun, et al.
Published: (2025)

Labrador: Exploring the Limits of Masked Language Modeling for Laboratory Data
by: Bellamy, David R., et al.
Published: (2023)

How Important Is Tokenization in French Medical Masked Language Models?
by: Labrak, Yanis, et al.
Published: (2024)

Masked Thought: Simply Masking Partial Reasoning Steps Can Improve Mathematical Reasoning Learning of Language Models
by: Chen, Changyu, et al.
Published: (2024)

Soft Self-Consistency Improves Language Model Agents
by: Wang, Han, et al.
Published: (2024)