Copertina

SetupBench: Assessing Software Engineering Agents' Ability to Bootstrap Development Environments

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Arora, Avi, Jang, Jinu, Moghaddam, Roshanak Zilouchian
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Software Engineering Artificial Intelligence Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

RefactorBench: Evaluating Stateful Reasoning in Language Agents Through Code
di: Gautam, Dhruv, et al.
Pubblicazione: (2025)

AutoDev: Automated AI-Driven Development
di: Tufano, Michele, et al.
Pubblicazione: (2024)

PerfBench: Can Agents Resolve Real-World Performance Bugs?
di: Garg, Spandan, et al.
Pubblicazione: (2025)

The SWE-Bench Illusion: When State-of-the-Art LLMs Remember Instead of Reason
di: Liang, Shanchao, et al.
Pubblicazione: (2025)

Copilot Evaluation Harness: Evaluating LLM-Guided Software Programming
di: Agarwal, Anisha, et al.
Pubblicazione: (2024)

RAPGen: An Approach for Fixing Code Inefficiencies in Zero-Shot
di: Garg, Spandan, et al.
Pubblicazione: (2023)

FaultLine: Automated Proof-of-Vulnerability Generation Using LLM Agents
di: Nitin, Vikram, et al.
Pubblicazione: (2025)

PIPer: On-Device Environment Setup via Online Reinforcement Learning
di: Kovrigin, Alexander, et al.
Pubblicazione: (2025)

Explainable Artificial Intelligence Techniques for Software Development Lifecycle: A Phase-specific Survey
di: Arora, Lakshit, et al.
Pubblicazione: (2025)

SWE-Replay: Efficient Test-Time Scaling for Software Engineering Agents
di: Ding, Yifeng, et al.
Pubblicazione: (2026)

Closing the Gap: A User Study on the Real-world Usefulness of AI-powered Vulnerability Detection & Repair in the IDE
di: Steenhoek, Benjamin, et al.
Pubblicazione: (2024)

SWE-MiniSandbox: Container-Free Reinforcement Learning for Building Software Engineering Agents
di: Yuan, Danlong, et al.
Pubblicazione: (2026)

Foundation Model Engineering: Engineering Foundation Models Just as Engineering Software
di: Ran, Dezhi, et al.
Pubblicazione: (2024)

EnvBench: A Benchmark for Automated Environment Setup
di: Eliseeva, Aleksandra, et al.
Pubblicazione: (2025)

Challenges and Paths Towards AI for Software Engineering
di: Gu, Alex, et al.
Pubblicazione: (2025)

On the Replicability and Reproducibility of Deep Learning in Software Engineering
di: Liu, Chao, et al.
Pubblicazione: (2020)

SWE-Bench-CL: Continual Learning for Coding Agents
di: Joshi, Thomas, et al.
Pubblicazione: (2025)

On Problems of Implicit Context Compression for Software Engineering Agents
di: Gelvan, Kirill, et al.
Pubblicazione: (2026)

Agentless: Demystifying LLM-based Software Engineering Agents
di: Xia, Chunqiu Steven, et al.
Pubblicazione: (2024)

LLMs in Coding and their Impact on the Commercial Software Engineering Landscape
di: Belozerov, Vladislav, et al.
Pubblicazione: (2025)

The Rise of AI Teammates in Software Engineering (SE) 3.0: How Autonomous Coding Agents Are Reshaping Software Engineering
di: Li, Hao, et al.
Pubblicazione: (2025)

Experiential Co-Learning of Software-Developing Agents
di: Qian, Chen, et al.
Pubblicazione: (2023)

Toward Explaining Large Language Models in Software Engineering Tasks
di: Vitale, Antonio, et al.
Pubblicazione: (2025)

EGSS: Entropy-guided Stepwise Scaling for Reliable Software Engineering
di: Mao, Chenhui, et al.
Pubblicazione: (2026)

Diversity Empowers Intelligence: Integrating Expertise of Software Engineering Agents
di: Zhang, Kexun, et al.
Pubblicazione: (2024)

SWE-Bench++: A Framework for the Scalable Generation of Software Engineering Benchmarks from Open-Source Repositories
di: Wang, Lilin, et al.
Pubblicazione: (2025)

CSR-Bench: Benchmarking LLM Agents in Deployment of Computer Science Research Repositories
di: Xiao, Yijia, et al.
Pubblicazione: (2025)

SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents
di: Mündler, Niels, et al.
Pubblicazione: (2024)

PostTrainBench: Can LLM Agents Automate LLM Post-Training?
di: Rank, Ben, et al.
Pubblicazione: (2026)

KernelBench: Can LLMs Write Efficient GPU Kernels?
di: Ouyang, Anne, et al.
Pubblicazione: (2025)

DevBench: A Realistic, Developer-Informed Benchmark for Code Generation Models
di: Kumarappan, Adarsh, et al.
Pubblicazione: (2026)

Towards a Classification of Open-Source ML Models and Datasets for Software Engineering
di: González, Alexandra, et al.
Pubblicazione: (2024)

Human-In-the-Loop Software Development Agents
di: Takerngsaksiri, Wannita, et al.
Pubblicazione: (2024)

Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?
di: Xia, Chunqiu Steven, et al.
Pubblicazione: (2025)

Towards Engineering Fair and Equitable Software Systems for Managing Low-Altitude Airspace Authorizations
di: Gohar, Usman, et al.
Pubblicazione: (2024)

DafnyBench: A Benchmark for Formal Software Verification
di: Loughridge, Chloe, et al.
Pubblicazione: (2024)

VibeTensor: System Software for Deep Learning, Fully Generated by AI Agents
di: Xu, Bing, et al.
Pubblicazione: (2026)

Teaching an Online Multi-Institutional Research Level Software Engineering Course with Industry -- an Experience Report
di: Jalote, Pankaj, et al.
Pubblicazione: (2025)

Protocol-Driven Development: Governing Generated Software Through Invariants and Continuous Evidence
di: He, Jun, et al.
Pubblicazione: (2026)

Usability and Performance Analysis of Embedded Development Environment for On-device Learning
di: Scaffi, Enzo, et al.
Pubblicazione: (2024)