Imagen de Portada

SWE-Bench++: A Framework for the Scalable Generation of Software Engineering Benchmarks from Open-Source Repositories

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Wang, Lilin, Ramalho, Lucas, Celestino, Alan, Pham, Phuc Anthony, Liu, Yu, Sinha, Umang Kumar, Portillo, Andres, Osunwa, Onassis, Maduekwe, Gabriel
Formato:	Preprint
Publicado:	2025
Materias:	Software Engineering Artificial Intelligence Computation and Language Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

SWE-Sharp-Bench: A Reproducible Benchmark for C# Software Engineering Tasks
por: Mhatre, Sanket, et al.
Publicado: (2025)

AbasyBench
por: Pham, Bao Phuc, et al.
Publicado: (2026)

SWE-Tester: Training Open-Source LLMs for Issue Reproduction in Real-World Repositories
por: Soni, Aditya Bharat, et al.
Publicado: (2026)

SWE-Next: Scalable Real-World Software Engineering Tasks for Agents
por: Liang, Jiarong, et al.
Publicado: (2026)

SWE-QA-Pro: A Representative Benchmark and Scalable Training Recipe for Repository-Level Code Understanding
por: Cai, Songcheng, et al.
Publicado: (2026)

SWE-Bench+: Enhanced Coding Benchmark for LLMs
por: Aleithan, Reem, et al.
Publicado: (2024)

SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
por: Deng, Xiang, et al.
Publicado: (2025)

SWE-Skills-Bench: Do Agent Skills Actually Help in Real-World Software Engineering?
por: Han, Tingxu, et al.
Publicado: (2026)

SWE-Hub: A Unified Production System for Scalable, Executable Software Engineering Tasks
por: Zeng, Yucheng, et al.
Publicado: (2026)

SWE-Bench 5G: Benchmarking AI Coding Agents on Telecom Network Engineering Tasks
por: Chen, Jiao, et al.
Publicado: (2026)

ATime-Consistent Benchmark for Repository-Level Software Engineering Evaluation
por: Xianpeng, et al.
Publicado: (2026)

SWE-smith: Scaling Data for Software Engineering Agents
por: Yang, John, et al.
Publicado: (2025)

Training Software Engineering Agents and Verifiers with SWE-Gym
por: Pan, Jiayi, et al.
Publicado: (2024)

BuildBench: Benchmarking LLM Agents on Compiling Real-World Open-Source Software
por: Zhang, Zehua, et al.
Publicado: (2025)

SWE Context Bench: A Benchmark for Context Learning in Coding
por: Zhu, Jiayuan, et al.
Publicado: (2026)

Revealing the value of Repository Centrality in lifespan prediction of Open Source Software Projects
por: He, Runzhi, et al.
Publicado: (2024)

TOM-SWE: User Mental Modeling For Software Engineering Agents
por: Zhou, Xuhui, et al.
Publicado: (2025)

SWE-RM: Execution-free Feedback For Software Engineering Agents
por: Shum, KaShun, et al.
Publicado: (2025)

Ambig-SWE: Interactive Agents to Overcome Underspecificity in Software Engineering
por: Vijayvargiya, Sanidhya, et al.
Publicado: (2025)

SWE-Refactor: A Repository-Level Benchmark for Real-World LLM-Based Code Refactoring
por: Xu, Yisen, et al.
Publicado: (2026)

What's in a Benchmark? The Case of SWE-Bench in Automated Program Repair
por: Martinez, Matias, et al.
Publicado: (2026)

SWE-MERA: A Dynamic Benchmark for Agenticly Evaluating Large Language Models on Software Engineering Tasks
por: Adamenko, Pavel, et al.
Publicado: (2025)

SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution
por: Wei, Yuxiang, et al.
Publicado: (2025)

From SWE-ZERO to SWE-HERO: Execution-free to Execution-based Fine-tuning for Software Engineering Agents
por: Ludwig, Nikolai, et al.
Publicado: (2026)

Exploring the Lifecycle and Maintenance Practices of Pre-Trained Models in Open-Source Software Repositories
por: Koohjani, Matin, et al.
Publicado: (2025)

Mining Quantum Software Patterns in Open-Source Projects
por: Ramalho, Neilson Carlos Leite, et al.
Publicado: (2026)

Resolving Java Code Repository Issues with iSWE Agent
por: Ganhotra, Jatin, et al.
Publicado: (2026)

NYU CTF Bench: A Scalable Open-Source Benchmark Dataset for Evaluating LLMs in Offensive Security
por: Shao, Minghao, et al.
Publicado: (2024)

Saving SWE-Bench: A Benchmark Mutation Approach for Realistic Agent Evaluation
por: Garg, Spandan, et al.
Publicado: (2025)

SWE-Arena: An Interactive Platform for Evaluating Foundation Models in Software Engineering
por: Zhao, Zhimin
Publicado: (2025)

SWE-Dev: Building Software Engineering Agents with Training and Inference Scaling
por: Wang, Haoran, et al.
Publicado: (2025)

Skywork-SWE: Unveiling Data Scaling Laws for Software Engineering in LLMs
por: Zeng, Liang, et al.
Publicado: (2025)

SWE-World: Building Software Engineering Agents in Docker-Free Environments
por: Sun, Shuang, et al.
Publicado: (2026)

SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering
por: Yang, John, et al.
Publicado: (2024)

SWE-Replay: Efficient Test-Time Scaling for Software Engineering Agents
por: Ding, Yifeng, et al.
Publicado: (2026)

AInsteinBench: Benchmarking Coding Agents on Scientific Repositories
por: Duston, Titouan, et al.
Publicado: (2025)

SWE-WebDevBench: Evaluating Coding Agent Application Platforms as Virtual Software Agencies
por: Saxena, Siddhant, et al.
Publicado: (2026)

SWE-Spot: Building Small Repo-Experts with Repository-Centric Learning
por: Peng, Jinjun, et al.
Publicado: (2026)

SWE-Flow: Synthesizing Software Engineering Data in a Test-Driven Manner
por: Zhang, Lei, et al.
Publicado: (2025)

Satori-SWE: Evolutionary Test-Time Scaling for Sample-Efficient Software Engineering
por: Zeng, Guangtao, et al.
Publicado: (2025)