Does Thinking More always Help? Mirage of Test-Time Scaling in Reasoning Models
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866912665503268864 |
|---|---|
| author | Ghosal, Soumya Suvra Chakraborty, Souradip Reddy, Avinash Lu, Yifu Wang, Mengdi Manocha, Dinesh Huang, Furong Ghavamzadeh, Mohammad Bedi, Amrit Singh |
| author_facet | Ghosal, Soumya Suvra Chakraborty, Souradip Reddy, Avinash Lu, Yifu Wang, Mengdi Manocha, Dinesh Huang, Furong Ghavamzadeh, Mohammad Bedi, Amrit Singh |
| contents | Recent trends in test-time scaling for reasoning models (e.g., OpenAI o1, DeepSeek R1) have led to a popular belief that extending thinking traces using prompts like "Wait" or "Let me rethink" can improve performance. This raises a natural question: Does thinking more at test-time truly lead to better reasoning? To answer this question, we perform a detailed empirical study across models and benchmarks, which reveals a consistent pattern of initial performance improvements from additional thinking followed by a decline, due to "overthinking". To understand this non-monotonic trend, we consider a simple probabilistic model, which reveals that additional thinking increases output variance-creating an illusion of improved reasoning while ultimately undermining precision. Thus, observed gains from "more thinking" are not true indicators of improved reasoning, but artifacts stemming from the connection between model uncertainty and evaluation metric. This suggests that test-time scaling through extended thinking is not an effective way to utilize the inference thinking budget. Recognizing these limitations, we introduce an alternative test-time scaling approach, parallel thinking, inspired by Best-of-N sampling. Our method generates multiple independent reasoning paths within the same inference budget and selects the most consistent response via majority vote, achieving up to 20% higher accuracy compared to extended thinking. This provides a simple yet effective mechanism for test-time scaling of reasoning models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_04210 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Does Thinking More always Help? Mirage of Test-Time Scaling in Reasoning Models Ghosal, Soumya Suvra Chakraborty, Souradip Reddy, Avinash Lu, Yifu Wang, Mengdi Manocha, Dinesh Huang, Furong Ghavamzadeh, Mohammad Bedi, Amrit Singh Artificial Intelligence Computation and Language Recent trends in test-time scaling for reasoning models (e.g., OpenAI o1, DeepSeek R1) have led to a popular belief that extending thinking traces using prompts like "Wait" or "Let me rethink" can improve performance. This raises a natural question: Does thinking more at test-time truly lead to better reasoning? To answer this question, we perform a detailed empirical study across models and benchmarks, which reveals a consistent pattern of initial performance improvements from additional thinking followed by a decline, due to "overthinking". To understand this non-monotonic trend, we consider a simple probabilistic model, which reveals that additional thinking increases output variance-creating an illusion of improved reasoning while ultimately undermining precision. Thus, observed gains from "more thinking" are not true indicators of improved reasoning, but artifacts stemming from the connection between model uncertainty and evaluation metric. This suggests that test-time scaling through extended thinking is not an effective way to utilize the inference thinking budget. Recognizing these limitations, we introduce an alternative test-time scaling approach, parallel thinking, inspired by Best-of-N sampling. Our method generates multiple independent reasoning paths within the same inference budget and selects the most consistent response via majority vote, achieving up to 20% higher accuracy compared to extended thinking. This provides a simple yet effective mechanism for test-time scaling of reasoning models. |
| title | Does Thinking More always Help? Mirage of Test-Time Scaling in Reasoning Models |
| topic | Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2506.04210 |