CodeScout: An Effective Recipe for Reinforcement Learning of Code Search Agents

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Sutawika, Lintang, Soni, Aditya Bharat, R, Bharath Sriraam R, Gandhi, Apurva, Yassine, Taha, Vijayvargiya, Sanidhya, Li, Yuchen, Zhou, Xuhui, Zhang, Yilin, Maben, Leander Melroy, Neubig, Graham
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912972900663296
author Sutawika, Lintang
Soni, Aditya Bharat
R, Bharath Sriraam R
Gandhi, Apurva
Yassine, Taha
Vijayvargiya, Sanidhya
Li, Yuchen
Zhou, Xuhui
Zhang, Yilin
Maben, Leander Melroy
Neubig, Graham
author_facet Sutawika, Lintang
Soni, Aditya Bharat
R, Bharath Sriraam R
Gandhi, Apurva
Yassine, Taha
Vijayvargiya, Sanidhya
Li, Yuchen
Zhou, Xuhui
Zhang, Yilin
Maben, Leander Melroy
Neubig, Graham
contents A prerequisite for coding agents to perform tasks on large repositories is code localization - the identification of relevant files, classes, and functions to work on. While repository-level code localization has been performed using embedding-based retrieval approaches such as vector search, recent work has focused on developing agents to localize relevant code either as a standalone precursor to or interleaved with performing actual work. Most prior methods on agentic code search equip the agent with complex, specialized tools, such as repository graphs derived from static analysis. In this paper, we demonstrate that, with an effective reinforcement learning recipe, a coding agent equipped with nothing more than a standard Unix terminal can be trained to achieve strong results. Our experiments on three benchmarks (SWE-Bench Verified, Pro, and Lite) reveal that our models consistently achieve superior or competitive performance over 2-18x larger base and post-trained LLMs and sometimes approach performance provided by closed models like Claude Sonnet, even when using specialized scaffolds. Our work particularly focuses on techniques for re-purposing existing coding agent environments for code search, reward design, and RL optimization. We release the resulting model family, CodeScout, along with all our code and data for the community to build upon.
format Preprint
id arxiv_https___arxiv_org_abs_2603_17829
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle CodeScout: An Effective Recipe for Reinforcement Learning of Code Search Agents
Sutawika, Lintang
Soni, Aditya Bharat
R, Bharath Sriraam R
Gandhi, Apurva
Yassine, Taha
Vijayvargiya, Sanidhya
Li, Yuchen
Zhou, Xuhui
Zhang, Yilin
Maben, Leander Melroy
Neubig, Graham
Software Engineering
Artificial Intelligence
Computation and Language
A prerequisite for coding agents to perform tasks on large repositories is code localization - the identification of relevant files, classes, and functions to work on. While repository-level code localization has been performed using embedding-based retrieval approaches such as vector search, recent work has focused on developing agents to localize relevant code either as a standalone precursor to or interleaved with performing actual work. Most prior methods on agentic code search equip the agent with complex, specialized tools, such as repository graphs derived from static analysis. In this paper, we demonstrate that, with an effective reinforcement learning recipe, a coding agent equipped with nothing more than a standard Unix terminal can be trained to achieve strong results. Our experiments on three benchmarks (SWE-Bench Verified, Pro, and Lite) reveal that our models consistently achieve superior or competitive performance over 2-18x larger base and post-trained LLMs and sometimes approach performance provided by closed models like Claude Sonnet, even when using specialized scaffolds. Our work particularly focuses on techniques for re-purposing existing coding agent environments for code search, reward design, and RL optimization. We release the resulting model family, CodeScout, along with all our code and data for the community to build upon.
title CodeScout: An Effective Recipe for Reinforcement Learning of Code Search Agents
topic Software Engineering
Artificial Intelligence
Computation and Language
url https://arxiv.org/abs/2603.17829