Mitigating Overthinking in Large Reasoning Language Models via Reasoning Path Deviation Monitoring
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914395206975488 |
|---|---|
| author | Guan, Weixin Li, Liang Liu, Jiapeng Li, Bing Fu, Peng Fang, Chengyang Hao, Xiaoshuai Ma, Can Wang, Weiping |
| author_facet | Guan, Weixin Li, Liang Liu, Jiapeng Li, Bing Fu, Peng Fang, Chengyang Hao, Xiaoshuai Ma, Can Wang, Weiping |
| contents | Large Reasoning Language Models (LRLMs) demonstrate impressive capabilities on complex tasks by utilizing long Chain-of-Thought reasoning. However, they are prone to overthinking, which generates redundant reasoning steps that degrade both performance and efficiency. Recently, early-exit strategies are proposed to mitigate overthinking by dynamically and adaptively terminating redundant reasoning. However, current early-exit methods either introduce extra training overhead by relying on proxy models or limit inference throughput due to the frequent content switching between reasoning and generating probing answers. Moreover, most early-exit methods harm LRLMs performance due to over-truncation. Our insight stems from an observation: overthinking often causes LRLMs to deviate from the correct reasoning path, which is frequently accompanied by high-entropy transition tokens. Given this, we propose an early-exit method deeply coupled with the native reasoning process, which leverages the path deviation index as a dedicated monitoring metric for the frequent occurrence of high-entropy transition tokens to dynamically detect and terminate overthinking trajectories. We conduct experiments across multiple benchmarks using LRLMs of different types and scales, and the results indicate that our method delivers the largest performance improvement over vanilla CoT compared to existing early-exit methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_14251 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Mitigating Overthinking in Large Reasoning Language Models via Reasoning Path Deviation Monitoring Guan, Weixin Li, Liang Liu, Jiapeng Li, Bing Fu, Peng Fang, Chengyang Hao, Xiaoshuai Ma, Can Wang, Weiping Computation and Language Artificial Intelligence Large Reasoning Language Models (LRLMs) demonstrate impressive capabilities on complex tasks by utilizing long Chain-of-Thought reasoning. However, they are prone to overthinking, which generates redundant reasoning steps that degrade both performance and efficiency. Recently, early-exit strategies are proposed to mitigate overthinking by dynamically and adaptively terminating redundant reasoning. However, current early-exit methods either introduce extra training overhead by relying on proxy models or limit inference throughput due to the frequent content switching between reasoning and generating probing answers. Moreover, most early-exit methods harm LRLMs performance due to over-truncation. Our insight stems from an observation: overthinking often causes LRLMs to deviate from the correct reasoning path, which is frequently accompanied by high-entropy transition tokens. Given this, we propose an early-exit method deeply coupled with the native reasoning process, which leverages the path deviation index as a dedicated monitoring metric for the frequent occurrence of high-entropy transition tokens to dynamically detect and terminate overthinking trajectories. We conduct experiments across multiple benchmarks using LRLMs of different types and scales, and the results indicate that our method delivers the largest performance improvement over vanilla CoT compared to existing early-exit methods. |
| title | Mitigating Overthinking in Large Reasoning Language Models via Reasoning Path Deviation Monitoring |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2603.14251 |