Towards Stepwise Domain Knowledge-Driven Reasoning Optimization and Reflection Improvement
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866909576711897088 |
|---|---|
| author | Liu, Chengyuan Wang, Shihang Qing, Lizhi Song, Kaisong Cao, Junjie Lin, Jun Zhang, Ji Li, Ang Kuang, Kun Wu, Fei |
| author_facet | Liu, Chengyuan Wang, Shihang Qing, Lizhi Song, Kaisong Cao, Junjie Lin, Jun Zhang, Ji Li, Ang Kuang, Kun Wu, Fei |
| contents | Recently, stepwise supervision on Chain of Thoughts (CoTs) presents an enhancement on the logical reasoning tasks such as coding and math, with the help of Monte Carlo Tree Search (MCTS). However, its contribution to tasks requiring domain-specific expertise and knowledge remains unexplored. Motivated by the interest, we identify several potential challenges of vanilla MCTS within this context, and propose the framework of Stepwise Domain Knowledge-Driven Reasoning Optimization, employing the MCTS algorithm to develop step-level supervision for problems that require essential comprehension, reasoning, and specialized knowledge. Additionally, we also introduce the Preference Optimization towards Reflection Paths, which iteratively learns self-reflection on the reasoning thoughts from better perspectives. We have conducted extensive experiments to evaluate the advantage of the methodologies. Empirical results demonstrate the effectiveness on various legal-domain problems. We also report a diverse set of valuable findings, hoping to encourage the enthusiasm to the research of domain-specific LLMs and MCTS. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_09058 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Towards Stepwise Domain Knowledge-Driven Reasoning Optimization and Reflection Improvement Liu, Chengyuan Wang, Shihang Qing, Lizhi Song, Kaisong Cao, Junjie Lin, Jun Zhang, Ji Li, Ang Kuang, Kun Wu, Fei Artificial Intelligence Computation and Language Recently, stepwise supervision on Chain of Thoughts (CoTs) presents an enhancement on the logical reasoning tasks such as coding and math, with the help of Monte Carlo Tree Search (MCTS). However, its contribution to tasks requiring domain-specific expertise and knowledge remains unexplored. Motivated by the interest, we identify several potential challenges of vanilla MCTS within this context, and propose the framework of Stepwise Domain Knowledge-Driven Reasoning Optimization, employing the MCTS algorithm to develop step-level supervision for problems that require essential comprehension, reasoning, and specialized knowledge. Additionally, we also introduce the Preference Optimization towards Reflection Paths, which iteratively learns self-reflection on the reasoning thoughts from better perspectives. We have conducted extensive experiments to evaluate the advantage of the methodologies. Empirical results demonstrate the effectiveness on various legal-domain problems. We also report a diverse set of valuable findings, hoping to encourage the enthusiasm to the research of domain-specific LLMs and MCTS. |
| title | Towards Stepwise Domain Knowledge-Driven Reasoning Optimization and Reflection Improvement |
| topic | Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2504.09058 |