Concise Reasoning via Reinforcement Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Fatemi, Mehdi, Rafiee, Banafsheh, Tang, Mingjie, Talamadupula, Kartik
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908668703801344
author Fatemi, Mehdi
Rafiee, Banafsheh
Tang, Mingjie
Talamadupula, Kartik
author_facet Fatemi, Mehdi
Rafiee, Banafsheh
Tang, Mingjie
Talamadupula, Kartik
contents A major drawback of reasoning models is their excessive token usage, inflating computational cost, resource demand, and latency. We show this verbosity stems not from deeper reasoning but from reinforcement learning loss minimization when models produce incorrect answers. With unsolvable problems dominating training, this effect compounds into a systematic tendency toward longer outputs. Through theoretical analysis of PPO and GRPO, we prove that incorrect answers inherently drive policies toward verbosity \textit{even when} $γ=1$, reframing response lengthening as an optimization artifact. We further uncover a consistent correlation between conciseness and correctness across reasoning and non-reasoning models. Building on these insights, we propose a two-phase RL procedure where a brief secondary stage, trained on a small set of solvable problems, significantly reduces response length while preserving or improving accuracy. Finally, we show that while GRPO shares properties with PPO, it exhibits collapse modes, limiting its reliability for concise reasoning. Our claims are supported by extensive experiments.
format Preprint
id arxiv_https___arxiv_org_abs_2504_05185
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Concise Reasoning via Reinforcement Learning
Fatemi, Mehdi
Rafiee, Banafsheh
Tang, Mingjie
Talamadupula, Kartik
Computation and Language
A major drawback of reasoning models is their excessive token usage, inflating computational cost, resource demand, and latency. We show this verbosity stems not from deeper reasoning but from reinforcement learning loss minimization when models produce incorrect answers. With unsolvable problems dominating training, this effect compounds into a systematic tendency toward longer outputs. Through theoretical analysis of PPO and GRPO, we prove that incorrect answers inherently drive policies toward verbosity \textit{even when} $γ=1$, reframing response lengthening as an optimization artifact. We further uncover a consistent correlation between conciseness and correctness across reasoning and non-reasoning models. Building on these insights, we propose a two-phase RL procedure where a brief secondary stage, trained on a small set of solvable problems, significantly reduces response length while preserving or improving accuracy. Finally, we show that while GRPO shares properties with PPO, it exhibits collapse modes, limiting its reliability for concise reasoning. Our claims are supported by extensive experiments.
title Concise Reasoning via Reinforcement Learning
topic Computation and Language
url https://arxiv.org/abs/2504.05185