Just Ask One More Time! Self-Agreement Improves Reasoning of Language Models in (Almost) All Scenarios
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2023
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866910458415415296 |
|---|---|
| author | Lin, Lei Fu, Jiayi Liu, Pengli Li, Qingyang Gong, Yan Wan, Junchen Zhang, Fuzheng Wang, Zhongyuan Zhang, Di Gai, Kun |
| author_facet | Lin, Lei Fu, Jiayi Liu, Pengli Li, Qingyang Gong, Yan Wan, Junchen Zhang, Fuzheng Wang, Zhongyuan Zhang, Di Gai, Kun |
| contents | Although chain-of-thought (CoT) prompting combined with language models has achieved encouraging results on complex reasoning tasks, the naive greedy decoding used in CoT prompting usually causes the repetitiveness and local optimality. To address this shortcoming, ensemble-optimization tries to obtain multiple reasoning paths to get the final answer assembly. However, current ensemble-optimization methods either simply employ rule-based post-processing such as \textit{self-consistency}, or train an additional model based on several task-related human annotations to select the best one among multiple reasoning paths, yet fail to generalize to realistic settings where the type of input questions is unknown or the answer format of reasoning paths is unknown. To avoid their limitations, we propose \textbf{Self-Agreement}, a generalizable ensemble-optimization method applying in almost all scenarios where the type of input questions and the answer format of reasoning paths may be known or unknown. Self-agreement firstly samples from language model's decoder to generate a \textit{diverse} set of reasoning paths, and subsequently prompts the language model \textit{one more time} to determine the optimal answer by selecting the most \textit{agreed} answer among the sampled reasoning paths. Self-agreement simultaneously achieves remarkable performance on six public reasoning benchmarks and superior generalization capabilities. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2311_08154 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Just Ask One More Time! Self-Agreement Improves Reasoning of Language Models in (Almost) All Scenarios Lin, Lei Fu, Jiayi Liu, Pengli Li, Qingyang Gong, Yan Wan, Junchen Zhang, Fuzheng Wang, Zhongyuan Zhang, Di Gai, Kun Computation and Language Artificial Intelligence Although chain-of-thought (CoT) prompting combined with language models has achieved encouraging results on complex reasoning tasks, the naive greedy decoding used in CoT prompting usually causes the repetitiveness and local optimality. To address this shortcoming, ensemble-optimization tries to obtain multiple reasoning paths to get the final answer assembly. However, current ensemble-optimization methods either simply employ rule-based post-processing such as \textit{self-consistency}, or train an additional model based on several task-related human annotations to select the best one among multiple reasoning paths, yet fail to generalize to realistic settings where the type of input questions is unknown or the answer format of reasoning paths is unknown. To avoid their limitations, we propose \textbf{Self-Agreement}, a generalizable ensemble-optimization method applying in almost all scenarios where the type of input questions and the answer format of reasoning paths may be known or unknown. Self-agreement firstly samples from language model's decoder to generate a \textit{diverse} set of reasoning paths, and subsequently prompts the language model \textit{one more time} to determine the optimal answer by selecting the most \textit{agreed} answer among the sampled reasoning paths. Self-agreement simultaneously achieves remarkable performance on six public reasoning benchmarks and superior generalization capabilities. |
| title | Just Ask One More Time! Self-Agreement Improves Reasoning of Language Models in (Almost) All Scenarios |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2311.08154 |