Saved in:
Bibliographic Details
Main Authors: Yao, Jian, Luo, Xiongcai, Cheng, Ran, Tan, Kay Chen
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2605.30832
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916064343883776
author Yao, Jian
Luo, Xiongcai
Cheng, Ran
Tan, Kay Chen
author_facet Yao, Jian
Luo, Xiongcai
Cheng, Ran
Tan, Kay Chen
contents Recent advances in Large Reasoning Models have significantly improved chain-of-thought (CoT) capabilities via reinforcement learning (RL). However, generated reasoning chains frequently suffer from structural redundancy (i.e., \emph{overthinking}), incurring high computational overhead without improving answer correctness. Existing mitigation strategies typically rely on token-uniform length penalties, which provide coarse, segment-agnostic pressure toward shorter outputs and can inadvertently suppress useful reasoning alongside redundancy. To address this, we demonstrate that inefficiency concentrates in high-probability segments with low marginal utility. We derive a theoretical characterization of segment suboptimality under the correctness-length trade-off objective and propose \textsc{SLAT} (Segment-Level Adaptive Trimming), an RL framework that selectively suppresses redundant segments based on this criterion. Empirical results on standard benchmarks indicate that \textsc{SLAT} establishes a superior accuracy-efficiency Pareto frontier, reducing reasoning length by $50\%$ relative to uncompressed baselines while maintaining competitive accuracy. Overall, our results suggest that theoretically grounded, segment-aware trimming is a promising direction for efficient CoT reasoning in large language models.
format Preprint
id arxiv_https___arxiv_org_abs_2605_30832
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle SLAT: Segment-Level Adaptive Trimming for Efficient CoT Reasoning
Yao, Jian
Luo, Xiongcai
Cheng, Ran
Tan, Kay Chen
Artificial Intelligence
Recent advances in Large Reasoning Models have significantly improved chain-of-thought (CoT) capabilities via reinforcement learning (RL). However, generated reasoning chains frequently suffer from structural redundancy (i.e., \emph{overthinking}), incurring high computational overhead without improving answer correctness. Existing mitigation strategies typically rely on token-uniform length penalties, which provide coarse, segment-agnostic pressure toward shorter outputs and can inadvertently suppress useful reasoning alongside redundancy. To address this, we demonstrate that inefficiency concentrates in high-probability segments with low marginal utility. We derive a theoretical characterization of segment suboptimality under the correctness-length trade-off objective and propose \textsc{SLAT} (Segment-Level Adaptive Trimming), an RL framework that selectively suppresses redundant segments based on this criterion. Empirical results on standard benchmarks indicate that \textsc{SLAT} establishes a superior accuracy-efficiency Pareto frontier, reducing reasoning length by $50\%$ relative to uncompressed baselines while maintaining competitive accuracy. Overall, our results suggest that theoretically grounded, segment-aware trimming is a promising direction for efficient CoT reasoning in large language models.
title SLAT: Segment-Level Adaptive Trimming for Efficient CoT Reasoning
topic Artificial Intelligence
url https://arxiv.org/abs/2605.30832