Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2507.14958 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916041804742656 |
|---|---|
| author | Yan, Hang Xu, Fangzhi Xu, Rongman Li, Yifei Zhang, Jian Luo, Haoran Wu, Xiaobao Tuan, Luu Anh Zhao, Haiteng Lin, Qika Liu, Jun |
| author_facet | Yan, Hang Xu, Fangzhi Xu, Rongman Li, Yifei Zhang, Jian Luo, Haoran Wu, Xiaobao Tuan, Luu Anh Zhao, Haiteng Lin, Qika Liu, Jun |
| contents | Large Language Models have achieved impressive performance on reasoning-intensive tasks, yet optimizing their reasoning efficiency remains an open challenge. While Test-Time Scaling (TTS) improves reasoning quality, it often leads to overthinking, wasting tokens on redundant computations. This work investigates how to efficiently and adaptively guide current model' test-time scaling without additional training. Inspired by the concept of momentum in physics, we propose Momentum Uncertainty-guided Reasoning (MUR), which dynamically allocates thinking budgets to critical reasoning steps by tracking and aggregating stepwise uncertainty over time. To support flexible inference-time control, we introduce gamma-control, a simple mechanism that tunes the reasoning budget via a single hyperparameter. We provide in-depth theoretical proof to support the superiority of MUR in terms of stability and biases. MUR is comprehensively evaluated against various TTS methods across four challenging benchmarks (MATH-500, AIME24, AIME25, and GPQA-diamond) using different sizes of recent Qwen3 models (1.7B, 4B, and 8B). Results demonstrate that MUR reduces computation by by over 45% on average while improving accuracy from 0.33 to 3.46%. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_14958 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | MUR: Momentum Uncertainty guided Reasoning for Large Language Models Yan, Hang Xu, Fangzhi Xu, Rongman Li, Yifei Zhang, Jian Luo, Haoran Wu, Xiaobao Tuan, Luu Anh Zhao, Haiteng Lin, Qika Liu, Jun Computation and Language Large Language Models have achieved impressive performance on reasoning-intensive tasks, yet optimizing their reasoning efficiency remains an open challenge. While Test-Time Scaling (TTS) improves reasoning quality, it often leads to overthinking, wasting tokens on redundant computations. This work investigates how to efficiently and adaptively guide current model' test-time scaling without additional training. Inspired by the concept of momentum in physics, we propose Momentum Uncertainty-guided Reasoning (MUR), which dynamically allocates thinking budgets to critical reasoning steps by tracking and aggregating stepwise uncertainty over time. To support flexible inference-time control, we introduce gamma-control, a simple mechanism that tunes the reasoning budget via a single hyperparameter. We provide in-depth theoretical proof to support the superiority of MUR in terms of stability and biases. MUR is comprehensively evaluated against various TTS methods across four challenging benchmarks (MATH-500, AIME24, AIME25, and GPQA-diamond) using different sizes of recent Qwen3 models (1.7B, 4B, and 8B). Results demonstrate that MUR reduces computation by by over 45% on average while improving accuracy from 0.33 to 3.46%. |
| title | MUR: Momentum Uncertainty guided Reasoning for Large Language Models |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2507.14958 |