Cover Image

SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Jimenez, Carlos E., Yang, John, Wettig, Alexander, Yao, Shunyu, Pei, Kexin, Press, Ofir, Narasimhan, Karthik
Format:	Preprint
Published:	2023
Subjects:	Computation and Language Artificial Intelligence Software Engineering
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

SWE-bench-java: A GitHub Issue Resolving Benchmark for Java
by: Zan, Daoguang, et al.
Published: (2024)

SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering
by: Yang, John, et al.
Published: (2024)

Characterizing the Failure Modes of LLMs in Resolving Real-World GitHub Issues
by: Jiang, Yanjie, et al.
Published: (2026)

SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?
by: Yang, John, et al.
Published: (2024)

Can GitHub Issues Help in App Review Classifications?
by: Abedini, Yasaman, et al.
Published: (2023)

GitHub Proxy Server: A tool for supporting massive data collection on GitHub
by: Borges, Hudson Silva, et al.
Published: (2025)

Classifying Issues in Open-source GitHub Repositories
by: Raaj, Amir Hossain, et al.
Published: (2025)

Guidelines for Developing Bots for GitHub
by: Wessel, Mairieli, et al.
Published: (2022)

Prioritising GitHub Priority Labels
by: Caddy, James, et al.
Published: (2024)

SWE-fficiency: Can Language Models Optimize Real-World Repositories on Real Workloads?
by: Ma, Jeffrey Jian, et al.
Published: (2025)

"My GitHub Sponsors profile is live!" Investigating the Impact of Twitter/X Mentions on GitHub Sponsors
by: Fan, Youmei, et al.
Published: (2024)

Beyond the YAML File: Understanding Real-World GitHub Actions Workflow Adoption
by: Khatami, Ali, et al.
Published: (2026)

What Makes a GitHub Issue Ready for Copilot?
by: Sayagh, Mohammed
Published: (2025)

The Impact of Sanctions on GitHub Developers and Activities
by: Fan, Youmei, et al.
Published: (2024)

Fingerprinting AI Coding Agents on GitHub
by: Ghaleb, Taher A.
Published: (2026)

On the GitHub Actions Language: Usage, Evolution, and Workflow Reliability
by: Bardsiri, Aref Talebzadeh, et al.
Published: (2026)

Analyzing the Accessibility of GitHub Repositories for PyPI and NPM Libraries
by: Tsakpinis, Alexandros, et al.
Published: (2024)

An Empirical Study of ChatGPT-Related Projects and Their Issues on GitHub
by: Lin, Zheng, et al.
Published: (2024)

On the effectiveness of Large Language Models for GitHub Workflows
by: Zhang, Xinyu, et al.
Published: (2024)

GitHub Marketplace for Automation and Innovation in Software Production
by: Saroar, SK Golam, et al.
Published: (2024)

Introducing Traceability in GitHub for Medical Software Development
by: Stirbu, Vlad, et al.
Published: (2021)

The Landscape of Toxicity: An Empirical Investigation of Toxicity on GitHub
by: Sarker, Jaydeb, et al.
Published: (2025)

Chaos Engineering in the Wild: Findings from GitHub
by: Owotogbe, Joshua, et al.
Published: (2025)

An Empirical Study of the Evolution of GitHub Actions Workflows
by: Mazrae, Pooya Rostami, et al.
Published: (2026)

GitHub Actions: The Impact on the Pull Request Process
by: Wessel, Mairieli, et al.
Published: (2022)

Agentic Much? Adoption of Coding Agents on GitHub
by: Robbes, Romain, et al.
Published: (2026)

Understanding and Predicting Derailment in Toxic Conversations on GitHub
by: Imran, Mia Mohammad, et al.
Published: (2025)

HackRep: A Large-Scale Dataset of GitHub Hackathon Projects
by: Halmans, Sjoerd, et al.
Published: (2026)

Deciphering WONTFIX: A Mixed-Method Study on Why GitHub Issues Get Rejected
by: Curtis, J. Alexander, et al.
Published: (2025)

Visual Analysis of GitHub Issues to Gain Insights
by: Proma, Rifat Ara, et al.
Published: (2024)

Can Highlighting Help GitHub Maintainers Track Security Fixes?
by: Liu, Xueqing, et al.
Published: (2024)

Exploring the Effect of Multiple Natural Languages on Code Suggestion Using GitHub Copilot
by: Koyanagi, Kei, et al.
Published: (2024)

Explaining GitHub Actions Failures with Large Language Models: Challenges, Insights, and Limitations
by: Valenzuela-Toledo, Pablo, et al.
Published: (2025)

SWE-smith: Scaling Data for Software Engineering Agents
by: Yang, John, et al.
Published: (2025)

OmniGIRL: A Multilingual and Multimodal Benchmark for GitHub Issue Resolution
by: Guo, Lianghong, et al.
Published: (2025)

IssueGuard: Real-Time Secret Leak Prevention Tool for GitHub Issue Reports
by: Rahman, Md Nafiu, et al.
Published: (2026)

Testing in the Evolving World of DL Systems:Insights from Python GitHub Projects
by: Ali, Qurban, et al.
Published: (2024)

Transforming Software Development: Evaluating the Efficiency and Challenges of GitHub Copilot in Real-World Projects
by: Pandey, Ruchika, et al.
Published: (2024)

GitBug-Actions: Building Reproducible Bug-Fix Benchmarks with GitHub Actions
by: Saavedra, Nuno, et al.
Published: (2023)

Where Is Self-admitted Code Generated by Large Language Models on GitHub?
by: Yu, Xiao, et al.
Published: (2024)