Efficient Paths and Dense Rewards: Probabilistic Flow Reasoning for Large Language Models
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866908763998388224 |
|---|---|
| author | Liu, Yan Zhang, Feng Ma, Zhanyu Xu, Jun Gao, Jiuchong Hao, Jinghua He, Renqing Liu, Han Deng, Yangdong |
| author_facet | Liu, Yan Zhang, Feng Ma, Zhanyu Xu, Jun Gao, Jiuchong Hao, Jinghua He, Renqing Liu, Han Deng, Yangdong |
| contents | High-quality chain-of-thought has demonstrated strong potential for unlocking the reasoning capabilities of large language models. However, current paradigms typically treat the reasoning process as an indivisible sequence, lacking an intrinsic mechanism to quantify step-wise information gain. This granularity gap manifests in two limitations: inference inefficiency from redundant exploration without explicit guidance, and optimization difficulty due to sparse outcome supervision or costly external verifiers. In this work, we propose CoT-Flow, a framework that reconceptualizes discrete reasoning steps as a continuous probabilistic flow, quantifying the contribution of each step toward the ground-truth answer. Built on this formulation, CoT-Flow enables two complementary methodologies: flow-guided decoding, which employs a greedy flow-based decoding strategy to extract information-efficient reasoning paths, and flow-based reinforcement learning, which constructs a verifier-free dense reward function. Experiments on challenging benchmarks demonstrate that CoT-Flow achieves a superior balance between inference efficiency and reasoning performance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_09260 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Efficient Paths and Dense Rewards: Probabilistic Flow Reasoning for Large Language Models Liu, Yan Zhang, Feng Ma, Zhanyu Xu, Jun Gao, Jiuchong Hao, Jinghua He, Renqing Liu, Han Deng, Yangdong Artificial Intelligence High-quality chain-of-thought has demonstrated strong potential for unlocking the reasoning capabilities of large language models. However, current paradigms typically treat the reasoning process as an indivisible sequence, lacking an intrinsic mechanism to quantify step-wise information gain. This granularity gap manifests in two limitations: inference inefficiency from redundant exploration without explicit guidance, and optimization difficulty due to sparse outcome supervision or costly external verifiers. In this work, we propose CoT-Flow, a framework that reconceptualizes discrete reasoning steps as a continuous probabilistic flow, quantifying the contribution of each step toward the ground-truth answer. Built on this formulation, CoT-Flow enables two complementary methodologies: flow-guided decoding, which employs a greedy flow-based decoding strategy to extract information-efficient reasoning paths, and flow-based reinforcement learning, which constructs a verifier-free dense reward function. Experiments on challenging benchmarks demonstrate that CoT-Flow achieves a superior balance between inference efficiency and reasoning performance. |
| title | Efficient Paths and Dense Rewards: Probabilistic Flow Reasoning for Large Language Models |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2601.09260 |