Repo2Run: Automated Building Executable Environment for Code Repository at Scale

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Hu, Ruida, Peng, Chao, Wang, Xinchen, Xu, Junjielong, Gao, Cuiyun
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908600987811840
author Hu, Ruida
Peng, Chao
Wang, Xinchen
Xu, Junjielong
Gao, Cuiyun
author_facet Hu, Ruida
Peng, Chao
Wang, Xinchen
Xu, Junjielong
Gao, Cuiyun
contents Scaling up executable code data is significant for improving language models' software engineering capability. The intricate nature of the process makes it labor-intensive, time-consuming and expert-knowledge-dependent to build a large number of executable code repositories, limiting the scalability of existing work based on running tests. The primary bottleneck lies in the automated building of test environments for different repositories, which is an essential yet underexplored task. To mitigate the gap, we introduce Repo2Run, the first LLM-based agent aiming at automating the building of executable test environments for any repositories at scale. Specifically, given a code repository, Repo2Run iteratively builds the Docker image, runs unit tests based on the feedback of the building, and synthesizes the Dockerfile until the entire pipeline is executed successfully. The resulting Dockerfile can then be used to create Docker container environments for running code and tests. We created a benchmark containing 420 Python repositories with unit tests for evaluation. The results illustrate that Repo2Run achieves an 86.0% success rate, outperforming SWE-agent by 77.0%. The resources of Repo2Run are available at https://github.com/bytedance/Repo2Run.
format Preprint
id arxiv_https___arxiv_org_abs_2502_13681
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Repo2Run: Automated Building Executable Environment for Code Repository at Scale
Hu, Ruida
Peng, Chao
Wang, Xinchen
Xu, Junjielong
Gao, Cuiyun
Software Engineering
Artificial Intelligence
Computation and Language
Machine Learning
Scaling up executable code data is significant for improving language models' software engineering capability. The intricate nature of the process makes it labor-intensive, time-consuming and expert-knowledge-dependent to build a large number of executable code repositories, limiting the scalability of existing work based on running tests. The primary bottleneck lies in the automated building of test environments for different repositories, which is an essential yet underexplored task. To mitigate the gap, we introduce Repo2Run, the first LLM-based agent aiming at automating the building of executable test environments for any repositories at scale. Specifically, given a code repository, Repo2Run iteratively builds the Docker image, runs unit tests based on the feedback of the building, and synthesizes the Dockerfile until the entire pipeline is executed successfully. The resulting Dockerfile can then be used to create Docker container environments for running code and tests. We created a benchmark containing 420 Python repositories with unit tests for evaluation. The results illustrate that Repo2Run achieves an 86.0% success rate, outperforming SWE-agent by 77.0%. The resources of Repo2Run are available at https://github.com/bytedance/Repo2Run.
title Repo2Run: Automated Building Executable Environment for Code Repository at Scale
topic Software Engineering
Artificial Intelligence
Computation and Language
Machine Learning
url https://arxiv.org/abs/2502.13681