Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2507.18578 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916971118854144 |
|---|---|
| author | Hong, Feng Yu, Geng Ye, Yushi Huang, Haicheng Zheng, Huangjie Zhang, Ya Wang, Yanfeng Yao, Jiangchao |
| author_facet | Hong, Feng Yu, Geng Ye, Yushi Huang, Haicheng Zheng, Huangjie Zhang, Ya Wang, Yanfeng Yao, Jiangchao |
| contents | Diffusion Large Language Models (DLLMs) have emerged as a compelling alternative to Autoregressive models, designed for fast parallel generation. However, existing DLLMs are plagued by a severe quality-speed trade-off, where faster parallel decoding leads to significant performance degradation. We attribute this to the irreversibility of standard decoding in DLLMs, which is easily polarized into the wrong decoding direction along with early error context accumulation. To resolve this, we introduce Wide-In, Narrow-Out (WINO), a training-free decoding algorithm that enables revokable decoding in DLLMs. WINO employs a parallel draft-and-verify mechanism, aggressively drafting multiple tokens while simultaneously using the model's bidirectional context to verify and re-mask suspicious ones for refinement. Verified in open-source DLLMs like LLaDA and MMaDA, WINO is shown to decisively improve the quality-speed trade-off. For instance, on the GSM8K math benchmark, it accelerates inference by 6$\times$ while improving accuracy by 2.58%; on Flickr30K captioning, it achieves a 10$\times$ speedup with higher performance. More comprehensive experiments are conducted to demonstrate the superiority and provide an in-depth understanding of WINO. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_18578 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Wide-In, Narrow-Out: Revokable Decoding for Efficient and Effective DLLMs Hong, Feng Yu, Geng Ye, Yushi Huang, Haicheng Zheng, Huangjie Zhang, Ya Wang, Yanfeng Yao, Jiangchao Computation and Language Diffusion Large Language Models (DLLMs) have emerged as a compelling alternative to Autoregressive models, designed for fast parallel generation. However, existing DLLMs are plagued by a severe quality-speed trade-off, where faster parallel decoding leads to significant performance degradation. We attribute this to the irreversibility of standard decoding in DLLMs, which is easily polarized into the wrong decoding direction along with early error context accumulation. To resolve this, we introduce Wide-In, Narrow-Out (WINO), a training-free decoding algorithm that enables revokable decoding in DLLMs. WINO employs a parallel draft-and-verify mechanism, aggressively drafting multiple tokens while simultaneously using the model's bidirectional context to verify and re-mask suspicious ones for refinement. Verified in open-source DLLMs like LLaDA and MMaDA, WINO is shown to decisively improve the quality-speed trade-off. For instance, on the GSM8K math benchmark, it accelerates inference by 6$\times$ while improving accuracy by 2.58%; on Flickr30K captioning, it achieves a 10$\times$ speedup with higher performance. More comprehensive experiments are conducted to demonstrate the superiority and provide an in-depth understanding of WINO. |
| title | Wide-In, Narrow-Out: Revokable Decoding for Efficient and Effective DLLMs |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2507.18578 |