SED: Self-Evaluation Decoding Enhances Large Language Models for Better Generation
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866917676050284544 |
|---|---|
| author | Luo, Ziqin Han, Haixia Zhao, Haokun Jiang, Guochao Du, Chengyu Li, Tingyun Liang, Jiaqing Yang, Deqing Xiao, Yanghua |
| author_facet | Luo, Ziqin Han, Haixia Zhao, Haokun Jiang, Guochao Du, Chengyu Li, Tingyun Liang, Jiaqing Yang, Deqing Xiao, Yanghua |
| contents | Existing Large Language Models (LLMs) generate text through unidirectional autoregressive decoding methods to respond to various user queries. These methods tend to consider token selection in a simple sequential manner, making it easy to fall into suboptimal options when encountering uncertain tokens, referred to as chaotic points in our work. Many chaotic points exist in texts generated by LLMs, and they often significantly affect the quality of subsequently generated tokens, which can interfere with LLMs' generation. This paper proposes Self-Evaluation Decoding, SED, a decoding method for enhancing model generation. Analogous to the human decision-making process, SED integrates speculation and evaluation steps into the decoding process, allowing LLMs to make more careful decisions and thus optimize token selection at chaotic points. Experimental results across various tasks using different LLMs demonstrate SED's effectiveness. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_16552 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | SED: Self-Evaluation Decoding Enhances Large Language Models for Better Generation Luo, Ziqin Han, Haixia Zhao, Haokun Jiang, Guochao Du, Chengyu Li, Tingyun Liang, Jiaqing Yang, Deqing Xiao, Yanghua Computation and Language Artificial Intelligence Existing Large Language Models (LLMs) generate text through unidirectional autoregressive decoding methods to respond to various user queries. These methods tend to consider token selection in a simple sequential manner, making it easy to fall into suboptimal options when encountering uncertain tokens, referred to as chaotic points in our work. Many chaotic points exist in texts generated by LLMs, and they often significantly affect the quality of subsequently generated tokens, which can interfere with LLMs' generation. This paper proposes Self-Evaluation Decoding, SED, a decoding method for enhancing model generation. Analogous to the human decision-making process, SED integrates speculation and evaluation steps into the decoding process, allowing LLMs to make more careful decisions and thus optimize token selection at chaotic points. Experimental results across various tasks using different LLMs demonstrate SED's effectiveness. |
| title | SED: Self-Evaluation Decoding Enhances Large Language Models for Better Generation |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2405.16552 |