Reasoning as a Resource: Optimizing Fast and Slow Thinking in Code Generation Models

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Li, Zongjie, Wang, Shuai
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908404017004544
author Li, Zongjie
Wang, Shuai
author_facet Li, Zongjie
Wang, Shuai
contents This position paper proposes a fundamental shift in designing code generation models: treating reasoning depth as a controllable resource. Rather than being an incidental byproduct of prompting, we argue that the trade-off between rapid, direct answers ("fast thinking") and elaborate, chain-of-thought deliberation ("slow thinking") must be explicitly managed. We contend that optimizing reasoning budgets across the entire model lifecycle - from synthetic data creation and benchmarking to real-world deploymen - can unlock superior trade-offs among accuracy, latency, and cost. This paper outlines how adaptive control over reasoning can enrich supervision signals, motivate new multi-dimensional benchmarks, and inform cost-aware, security-conscious deployment policies. By viewing fast and slow thinking as complementary modes to be scheduled, we envision coding agents that think deep when necessary and act fast when possible.
format Preprint
id arxiv_https___arxiv_org_abs_2506_09396
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Reasoning as a Resource: Optimizing Fast and Slow Thinking in Code Generation Models
Li, Zongjie
Wang, Shuai
Software Engineering
Artificial Intelligence
This position paper proposes a fundamental shift in designing code generation models: treating reasoning depth as a controllable resource. Rather than being an incidental byproduct of prompting, we argue that the trade-off between rapid, direct answers ("fast thinking") and elaborate, chain-of-thought deliberation ("slow thinking") must be explicitly managed. We contend that optimizing reasoning budgets across the entire model lifecycle - from synthetic data creation and benchmarking to real-world deploymen - can unlock superior trade-offs among accuracy, latency, and cost. This paper outlines how adaptive control over reasoning can enrich supervision signals, motivate new multi-dimensional benchmarks, and inform cost-aware, security-conscious deployment policies. By viewing fast and slow thinking as complementary modes to be scheduled, we envision coding agents that think deep when necessary and act fast when possible.
title Reasoning as a Resource: Optimizing Fast and Slow Thinking in Code Generation Models
topic Software Engineering
Artificial Intelligence
url https://arxiv.org/abs/2506.09396