Imagen de Portada

Mask Is What DLLM Needs: A Masked Data Training Paradigm for Diffusion LLMs

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Ma, Linrui, Cui, Yufei, Han, Kai, Wang, Yunhe
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Diffusion In Diffusion: Reclaiming Global Coherence in Semi-Autoregressive Diffusion
por: Ma, Linrui, et al.
Publicado: (2026)

Simplified and Generalized Masked Diffusion for Discrete Data
por: Shi, Jiaxin, et al.
Publicado: (2024)

Where to Mask: Structure-Guided Masking for Graph Masked Autoencoders
por: Liu, Chuang, et al.
Publicado: (2024)

Masked Generative Transformer Is What You Need for Image Editing
por: Chow, Wei, et al.
Publicado: (2026)

Training-Free Self-Correction for Multimodal Masked Diffusion Models
por: Ouyang, Yidong, et al.
Publicado: (2026)

Stop Training for the Worst: Progressive Unmasking Accelerates Masked Diffusion Training
por: Kim, Jaeyeon, et al.
Publicado: (2026)

DLLM-Searcher: Adapting Diffusion Large Language Model for Search Agents
por: Zhao, Jiahao, et al.
Publicado: (2026)

Beyond Manually Designed Pruning Policies with Second-Level Performance Prediction: A Pruning Framework for LLMs
por: Ma, Zuxin, et al.
Publicado: (2025)

What Exactly Does Guidance Do in Masked Discrete Diffusion Models
por: Ye, He, et al.
Publicado: (2025)

Chem4DLLM: 4D Multimodal LLMs for Chemical Dynamics Understanding
por: Li, Xinyu, et al.
Publicado: (2026)

Bringing Stability to Diffusion: Decomposing and Reducing Variance of Training Masked Diffusion Models
por: Jia, Mengni, et al.
Publicado: (2025)

Simultaneous Masking, Not Prompting Optimization: A Paradigm Shift in Fine-tuning LLMs for Simultaneous Translation
por: Raffel, Matthew, et al.
Publicado: (2024)

Beyond Masked and Unmasked: Discrete Diffusion Models via Partial Masking
por: Chao, Chen-Hao, et al.
Publicado: (2025)

Self-Speculative Masked Diffusions
por: Campbell, Andrew, et al.
Publicado: (2025)

Train for the Worst, Plan for the Best: Understanding Token Ordering in Masked Diffusions
por: Kim, Jaeyeon, et al.
Publicado: (2025)

MDPO: Overcoming the Training-Inference Divide of Masked Diffusion Language Models
por: He, Haoyu, et al.
Publicado: (2025)

Reconsidering Positional Supervision in Masked Diffusion Language Model Training
por: Ye, Mengyu, et al.
Publicado: (2026)

Fast Training of Diffusion Models with Masked Transformers
por: Zheng, Hongkai, et al.
Publicado: (2023)

Understanding and Accelerating the Training of Masked Diffusion Language Models
por: Hong, Chunsan, et al.
Publicado: (2026)

Auto-Regressive Masked Diffusion Models
por: Karami, Mahdi, et al.
Publicado: (2026)

Guided Star-Shaped Masked Diffusion
por: Meshchaninov, Viacheslav, et al.
Publicado: (2025)

Demystifying MaskGIT Sampler and Beyond: Adaptive Order Selection in Masked Diffusion
por: Hayakawa, Satoshi, et al.
Publicado: (2025)

Is Tokenization Needed for Masked Particle Modelling?
por: Leigh, Matthew, et al.
Publicado: (2024)

Watermarking Needs Input Repetition Masking
por: Khachaturov, David, et al.
Publicado: (2025)

Masked Completion via Structured Diffusion with White-Box Transformers
por: Pai, Druv, et al.
Publicado: (2024)

Masked Diffusion for Generative Recommendation
por: Shah, Kulin, et al.
Publicado: (2025)

Backdooring Masked Diffusion Language Models
por: Cao, Daniel Yiming, et al.
Publicado: (2026)

Sharp Convergence Rates for Masked Diffusion Models
por: Liang, Yuchen, et al.
Publicado: (2026)

Optimal Inference Schedules for Masked Diffusion Models
por: Chen, Sitan, et al.
Publicado: (2025)

Any-Order Flexible Length Masked Diffusion
por: Kim, Jaeyeon, et al.
Publicado: (2025)

FlashMask: Efficient and Rich Mask Extension of FlashAttention
por: Wang, Guoxia, et al.
Publicado: (2024)

Masked Autoencoders Are Effective Tokenizers for Diffusion Models
por: Chen, Hao, et al.
Publicado: (2025)

Masked Diffusion Modeling for Anomaly Detection
por: Zhang, Lixing, et al.
Publicado: (2026)

Variational Masked Diffusion Models
por: Zhang, Yichi, et al.
Publicado: (2025)

Latent Shadows: The Gaussian-Discrete Duality in Masked Diffusion
por: Chen, Guinan, et al.
Publicado: (2026)

Partition Generative Modeling: Masked Modeling Without Masks
por: Deschenaux, Justin, et al.
Publicado: (2025)

A Diffusion Model for Regular Time Series Generation from Irregular Data with Completion and Masking
por: Fadlon, Gal, et al.
Publicado: (2025)

UnMaskFork: Test-Time Scaling for Masked Diffusion via Deterministic Action Branching
por: Misaki, Kou, et al.
Publicado: (2026)

The Design Space of Tri-Modal Masked Diffusion Models
por: Bethune, Louis, et al.
Publicado: (2026)

MaskVD: Region Masking for Efficient Video Object Detection
por: Sarkar, Sreetama, et al.
Publicado: (2024)