MixReasoning: Switching Modes to Think

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lu, Haiquan, Fang, Gongfan, Ma, Xinyin, Li, Qi, Wang, Xinchao
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914079673679872
author Lu, Haiquan
Fang, Gongfan
Ma, Xinyin
Li, Qi
Wang, Xinchao
author_facet Lu, Haiquan
Fang, Gongfan
Ma, Xinyin
Li, Qi
Wang, Xinchao
contents Reasoning models enhance performance by tackling problems in a step-by-step manner, decomposing them into sub-problems and exploring long chains of thought before producing an answer. However, applying extended reasoning to every step introduces substantial redundancy, as sub-problems vary widely in difficulty and complexity: a small number of pivotal steps are genuinely challenging and decisive for the final answer, while many others only involve straightforward revisions or simple computations. Therefore, a natural idea is to endow reasoning models with the ability to adaptively respond to this variation, rather than treating all steps with the same level of elaboration. To this end, we propose MixReasoning, a framework that dynamically adjusts the depth of reasoning within a single response. The resulting chain of thought then becomes a mixture of detailed reasoning on difficult steps and concise inference on simpler ones. Experiments on GSM8K, MATH-500, and AIME show that MixReasoning shortens reasoning length and substantially improves efficiency without compromising accuracy.
format Preprint
id arxiv_https___arxiv_org_abs_2510_06052
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MixReasoning: Switching Modes to Think
Lu, Haiquan
Fang, Gongfan
Ma, Xinyin
Li, Qi
Wang, Xinchao
Artificial Intelligence
Computation and Language
Reasoning models enhance performance by tackling problems in a step-by-step manner, decomposing them into sub-problems and exploring long chains of thought before producing an answer. However, applying extended reasoning to every step introduces substantial redundancy, as sub-problems vary widely in difficulty and complexity: a small number of pivotal steps are genuinely challenging and decisive for the final answer, while many others only involve straightforward revisions or simple computations. Therefore, a natural idea is to endow reasoning models with the ability to adaptively respond to this variation, rather than treating all steps with the same level of elaboration. To this end, we propose MixReasoning, a framework that dynamically adjusts the depth of reasoning within a single response. The resulting chain of thought then becomes a mixture of detailed reasoning on difficult steps and concise inference on simpler ones. Experiments on GSM8K, MATH-500, and AIME show that MixReasoning shortens reasoning length and substantially improves efficiency without compromising accuracy.
title MixReasoning: Switching Modes to Think
topic Artificial Intelligence
Computation and Language
url https://arxiv.org/abs/2510.06052