A Survey on Parallel Reasoning
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912645976686592 |
|---|---|
| author | Wang, Ziqi Niu, Boye Gao, Zipeng Zheng, Zhi Xu, Tong Meng, Linghui Li, Zhongli Liu, Jing Chen, Yilong Zhu, Chen Wu, Hua Wang, Haifeng Chen, Enhong |
| author_facet | Wang, Ziqi Niu, Boye Gao, Zipeng Zheng, Zhi Xu, Tong Meng, Linghui Li, Zhongli Liu, Jing Chen, Yilong Zhu, Chen Wu, Hua Wang, Haifeng Chen, Enhong |
| contents | With the increasing capabilities of Large Language Models (LLMs), parallel reasoning has emerged as a new inference paradigm that enhances reasoning robustness by concurrently exploring multiple lines of thought before converging on a final answer. It has become a significant trend to explore parallel reasoning to overcome the fragility of standard sequential methods and improve practical performance. In this paper, we aim to survey and summarize the progress and challenges of parallel reasoning. We first present a formal definition of parallel reasoning and clarify its distinction from related concepts like Chain-of-Thought. Then, we organize and discuss advanced techniques based on a novel taxonomy, including non-interactive reasoning, interactive reasoning, and efficiency-focused decoding strategies. Additionally, we explore various application scenarios, such as solving complex problems and enhancing the reliability of LLM outputs.Finally, we highlight the core challenges of parallel reasoning and suggest potential directions for future research. We hope that our work can provide a useful roadmap for beginners and encourage more research on improving parallel reasoning methods. Related source can be avaliable in https://github.com/PPPP-kaqiu/Awesome-Parallel-Reasoning. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_12164 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A Survey on Parallel Reasoning Wang, Ziqi Niu, Boye Gao, Zipeng Zheng, Zhi Xu, Tong Meng, Linghui Li, Zhongli Liu, Jing Chen, Yilong Zhu, Chen Wu, Hua Wang, Haifeng Chen, Enhong Computation and Language With the increasing capabilities of Large Language Models (LLMs), parallel reasoning has emerged as a new inference paradigm that enhances reasoning robustness by concurrently exploring multiple lines of thought before converging on a final answer. It has become a significant trend to explore parallel reasoning to overcome the fragility of standard sequential methods and improve practical performance. In this paper, we aim to survey and summarize the progress and challenges of parallel reasoning. We first present a formal definition of parallel reasoning and clarify its distinction from related concepts like Chain-of-Thought. Then, we organize and discuss advanced techniques based on a novel taxonomy, including non-interactive reasoning, interactive reasoning, and efficiency-focused decoding strategies. Additionally, we explore various application scenarios, such as solving complex problems and enhancing the reliability of LLM outputs.Finally, we highlight the core challenges of parallel reasoning and suggest potential directions for future research. We hope that our work can provide a useful roadmap for beginners and encourage more research on improving parallel reasoning methods. Related source can be avaliable in https://github.com/PPPP-kaqiu/Awesome-Parallel-Reasoning. |
| title | A Survey on Parallel Reasoning |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2510.12164 |