Cover Image

Diffusion Language Models are Super Data Learners

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ni, Jinjie, Liu, Qian, Dou, Longxu, Du, Chao, Wang, Zili, Yan, Hang, Pang, Tianyu, Shieh, Michael Qizhe
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Training Optimal Large Diffusion Language Models
by: Ni, Jinjie, et al.
Published: (2025)

NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation
by: Liu, Xiangyan, et al.
Published: (2025)

Efficient Process Reward Model Training via Active Learning
by: Duan, Keyu, et al.
Published: (2025)

SynthRL: Scaling Visual Reasoning with Verifiable Data Synthesis
by: Wu, Zijian, et al.
Published: (2025)

LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization
by: Chen, Guanzheng, et al.
Published: (2025)

Nonparametric Data Attribution for Diffusion Models
by: Zhao, Yutian, et al.
Published: (2025)

Unnatural Languages Are Not Bugs but Features for LLMs
by: Duan, Keyu, et al.
Published: (2025)

Gradually Compacting Large Language Models for Reasoning Like a Boiling Frog
by: Zhao, Yiran, et al.
Published: (2026)

Intriguing Properties of Data Attribution on Diffusion Models
by: Zheng, Xiaosen, et al.
Published: (2023)

Purifying Large Language Models by Ensembling a Small Language Model
by: Li, Tianlin, et al.
Published: (2024)

When Attention Sink Emerges in Language Models: An Empirical View
by: Gu, Xiangming, et al.
Published: (2024)

Bootstrapping Language Models with DPO Implicit Rewards
by: Chen, Changyu, et al.
Published: (2024)

Scaling up Masked Diffusion Models on Text
by: Nie, Shen, et al.
Published: (2024)

Improving Long-Text Alignment for Text-to-Image Diffusion Models
by: Liu, Luping, et al.
Published: (2024)

FluidML: Fast and Memory Efficient Inference Optimization
by: Liu, Jinjie, et al.
Published: (2024)

Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses
by: Zheng, Xiaosen, et al.
Published: (2024)

On Memorization in Diffusion Models
by: Gu, Xiangming, et al.
Published: (2023)

Test-Time Backdoor Attacks on Multimodal Large Language Models
by: Lu, Dong, et al.
Published: (2024)

Diffusion Language Models Are Versatile Protein Learners
by: Wang, Xinyou, et al.
Published: (2024)

Variational Reasoning for Language Models
by: Zhou, Xiangxin, et al.
Published: (2025)

Advancing Adversarial Suffix Transfer Learning on Aligned Large Language Models
by: Liu, Hongfu, et al.
Published: (2024)

Scalable Token-Level Hallucination Detection in Large Language Models
by: Min, Rui, et al.
Published: (2026)

Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs
by: Zhang, Xuan, et al.
Published: (2024)

Graph Diffusion Policy Optimization
by: Liu, Yijing, et al.
Published: (2024)

Improving Your Model Ranking on Chatbot Arena by Vote Rigging
by: Min, Rui, et al.
Published: (2025)

Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates
by: Zheng, Xiaosen, et al.
Published: (2024)

A Closer Look at Machine Unlearning for Large Language Models
by: Yuan, Xiaojian, et al.
Published: (2024)

Finetuning Text-to-Image Diffusion Models for Fairness
by: Shen, Xudong, et al.
Published: (2023)

Lifelong Safety Alignment for Language Models
by: Wang, Haoyu, et al.
Published: (2025)

RAPID: Long-Context Inference with Retrieval-Augmented Speculative Decoding
by: Chen, Guanzheng, et al.
Published: (2025)

Conformalized Super Learner
by: Wu, Zhanli, et al.
Published: (2026)

Meta-Unlearning on Diffusion Models: Preventing Relearning Unlearned Concepts
by: Gao, Hongcheng, et al.
Published: (2024)

A Density Ratio Super Learner
by: Wu, Wencheng, et al.
Published: (2024)

Language Models Can Learn from Verbal Feedback Without Scalar Rewards
by: Luo, Renjie, et al.
Published: (2025)

Improved Techniques for Optimization-Based Jailbreaking on Large Language Models
by: Jia, Xiaojun, et al.
Published: (2024)

SEMRes-DDPM: Residual Network Based Diffusion Modelling Applied to Imbalanced Data
by: Zheng, Ming, et al.
Published: (2024)

RegMix: Data Mixture as Regression for Language Model Pre-training
by: Liu, Qian, et al.
Published: (2024)

An $\tilde{O}$ptimal Differentially Private Learner for Concept Classes with VC Dimension 1
by: Yan, Chao
Published: (2025)

A Class-Aware Representation Refinement Framework for Graph Classification
by: Xu, Jiaxing, et al.
Published: (2022)

Beyond Language Models: Byte Models are Digital World Simulators
by: Wu, Shangda, et al.
Published: (2024)