Copertina

Reconsidering Positional Supervision in Masked Diffusion Language Model Training

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Ye, Mengyu, Kudo, Keito, Takahashi, Ryosuke, Suzuki, Jun
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Computation and Language Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Understanding and Accelerating the Training of Masked Diffusion Language Models
di: Hong, Chunsan, et al.
Pubblicazione: (2026)

Scaling Beyond Masked Diffusion Language Models
di: Sahoo, Subham Sekhar, et al.
Pubblicazione: (2026)

Diffusion-State Policy Optimization for Masked Diffusion Language Models
di: Oba, Daisuke, et al.
Pubblicazione: (2026)

DOS: Dependency-Oriented Sampler for Masked Diffusion Language Models
di: Zhou, Xueyu, et al.
Pubblicazione: (2026)

Soft-Masked Diffusion Language Models
di: Hersche, Michael, et al.
Pubblicazione: (2025)

Adaptive Guidance for Retrieval-Augmented Masked Diffusion Models
di: Kim, Jaemin, et al.
Pubblicazione: (2026)

Simple and Effective Masked Diffusion Language Models
di: Sahoo, Subham Sekhar, et al.
Pubblicazione: (2024)

On the Reasoning Abilities of Masked Diffusion Language Models
di: Svete, Anej, et al.
Pubblicazione: (2025)

Not All Denoising Steps Are Equal: Model Scheduling for Faster Masked Diffusion Language Models
di: Sedykh, Ivan, et al.
Pubblicazione: (2026)

A Multi-Agent Probabilistic Inference Framework Inspired by Kairanban-Style CoT System with IdoBata Conversation for Debiasing
di: Ueno, Takato, et al.
Pubblicazione: (2025)

Tree Reward-Aligned Search for TReASURe in Masked Diffusion Language Models
di: Yu, Zichao, et al.
Pubblicazione: (2025)

Masked Diffusion Models are Secretly Time-Agnostic Masked Models and Exploit Inaccurate Categorical Sampling
di: Zheng, Kaiwen, et al.
Pubblicazione: (2024)

DualDiffusion: A Speculative Decoding Strategy for Masked Diffusion Models
di: Goyal, Satyam, et al.
Pubblicazione: (2026)

Improving Text Style Transfer using Masked Diffusion Language Models with Inference-time Scaling
di: Padole, Tejomay Kishor, et al.
Pubblicazione: (2025)

Faithfulness Measurable Masked Language Models
di: Madsen, Andreas, et al.
Pubblicazione: (2023)

Representation Deficiency in Masked Language Modeling
di: Meng, Yu, et al.
Pubblicazione: (2023)

Large Language Diffusion Models
di: Nie, Shen, et al.
Pubblicazione: (2025)

Variational Masked Diffusion Models
di: Zhang, Yichi, et al.
Pubblicazione: (2025)

LogicDiff: Logic-Guided Denoising Improves Zero-Shot Reasoning in Masked Diffusion Language Models
di: Aman, Shaik
Pubblicazione: (2026)

ILRR: Inference-Time Steering Method for Masked Diffusion Language Models
di: Avrahami, Eden, et al.
Pubblicazione: (2026)

Contextual Text Denoising with Masked Language Models
di: Sun, Yifu, et al.
Pubblicazione: (2019)

Centered Masking for Language-Image Pre-Training
di: Liang, Mingliang, et al.
Pubblicazione: (2024)

Pre-training LLM without Learning Rate Decay Enhances Supervised Fine-Tuning
di: Yano, Kazuki, et al.
Pubblicazione: (2026)

Scaffolded Language Models with Language Supervision for Mixed-Autonomy: A Survey
di: Lin, Matthieu, et al.
Pubblicazione: (2024)

Masked Diffusion Models as Energy Minimization
di: Chen, Sitong, et al.
Pubblicazione: (2025)

How to Train Text Summarization Model with Weak Supervisions
di: Wang, Yanbo, et al.
Pubblicazione: (2024)

Global Contrastive Training for Multimodal Electronic Health Records with Language Supervision
di: Ma, Yingbo, et al.
Pubblicazione: (2024)

Training Optimal Large Diffusion Language Models
di: Ni, Jinjie, et al.
Pubblicazione: (2025)

Parallel Sampling from Masked Diffusion Models via Conditional Independence Testing
di: Azangulov, Iskander, et al.
Pubblicazione: (2025)

Discovering Latent Knowledge in Language Models Without Supervision
di: Burns, Collin, et al.
Pubblicazione: (2022)

Mechanism Shift During Post-training from Autoregressive to Masked Diffusion Language Models
di: Kong, Injin, et al.
Pubblicazione: (2026)

Parallelism and Generation Order in Masked Diffusion Language Models: Limits Today, Potential Tomorrow
di: Zhong, Yangyang, et al.
Pubblicazione: (2026)

Beyond Masks: Efficient, Flexible Diffusion Language Models via Deletion-Insertion Processes
di: Ding, Fangyu, et al.
Pubblicazione: (2026)

Scaling up Masked Diffusion Models on Text
di: Nie, Shen, et al.
Pubblicazione: (2024)

Beyond Mode-Seeking RL: Trajectory-Balance Post-Training for Diffusion Language Models
di: Ahmadi, Saba, et al.
Pubblicazione: (2026)

Towards Probabilistically-Sound Beam Search with Masked Language Models
di: Brooks, Creston, et al.
Pubblicazione: (2024)

Memes-as-Replies: Can Models Select Humorous Manga Panel Responses?
di: Kohita, Ryosuke, et al.
Pubblicazione: (2026)

CIEGAD: Cluster-Conditioned Interpolative and Extrapolative Framework for Geometry-Aware and Domain-Aligned Data Augmentation
di: Inoshita, Keito, et al.
Pubblicazione: (2025)

Self-Supervised Position Debiasing for Large Language Models
di: Liu, Zhongkun, et al.
Pubblicazione: (2024)

RIV: Recursive Introspection Mask Diffusion Vision Language Model
di: Li, YuQian, et al.
Pubblicazione: (2025)