Cover Image

Beyond Final Code: A Process-Oriented Error Analysis of Software Development Agents in Real-World GitHub Scenarios

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Zhi, Ma, Wei, Jiang, Lingxiao
Format:	Preprint
Published:	2025
Subjects:	Software Engineering Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Evaluating Software Development Agents: Patch Patterns, Code Quality, and Issue Complexity in Real-World GitHub Scenarios
by: Chen, Zhi, et al.
Published: (2024)

Transforming Software Development: Evaluating the Efficiency and Challenges of GitHub Copilot in Real-World Projects
by: Pandey, Ruchika, et al.
Published: (2024)

AIDev: Studying AI Coding Agents on GitHub
by: Li, Hao, et al.
Published: (2026)

Fingerprinting AI Coding Agents on GitHub
by: Ghaleb, Taher A.
Published: (2026)

GitHub Copilot: the perfect Code compLeeter?
by: Siroš, Ilja, et al.
Published: (2024)

Introducing Traceability in GitHub for Medical Software Development
by: Stirbu, Vlad, et al.
Published: (2021)

Agentic Much? Adoption of Coding Agents on GitHub
by: Robbes, Romain, et al.
Published: (2026)

Immersion in the GitHub Universe: Scaling Coding Agents to Mastery
by: Zhao, Jiale, et al.
Published: (2026)

Uncovering Code Insights: Leveraging GitHub Artifacts for Deeper Code Understanding
by: Nevo, Ziv, et al.
Published: (2025)

Characterizing the Failure Modes of LLMs in Resolving Real-World GitHub Issues
by: Jiang, Yanjie, et al.
Published: (2026)

MAGIS: LLM-Based Multi-Agent Framework for GitHub Issue Resolution
by: Tao, Wei, et al.
Published: (2024)

Guidelines for Developing Bots for GitHub
by: Wessel, Mairieli, et al.
Published: (2022)

Beyond the YAML File: Understanding Real-World GitHub Actions Workflow Adoption
by: Khatami, Ali, et al.
Published: (2026)

GitHub Marketplace: Driving Automation and Fostering Innovation in Software Development
by: Saroar, SK. Golam, et al.
Published: (2025)

Using LLMs in Software Design: An Empirical Study of GitHub and A Practitioner Survey
by: Wang, Yifei, et al.
Published: (2026)

SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
by: Jimenez, Carlos E., et al.
Published: (2023)

GitHub Marketplace for Automation and Innovation in Software Production
by: Saroar, SK Golam, et al.
Published: (2024)

The Role of GitHub Copilot on Software Development: A Perspective on Productivity, Security, Best Practices and Future Directions
by: Nettur, Suresh Babu, et al.
Published: (2025)

The Impact of Sanctions on GitHub Developers and Activities
by: Fan, Youmei, et al.
Published: (2024)

Where Do AI Coding Agents Fail? An Empirical Study of Failed Agentic Pull Requests in GitHub
by: Ehsani, Ramtin, et al.
Published: (2026)

How Do Software Developers Use GitHub Actions to Automate Their Workflows?
by: Kinsman, Timothy, et al.
Published: (2021)

GitHub Proxy Server: A tool for supporting massive data collection on GitHub
by: Borges, Hudson Silva, et al.
Published: (2025)

GitHub Actions: The Impact on the Pull Request Process
by: Wessel, Mairieli, et al.
Published: (2022)

Programming with AI: Evaluating ChatGPT, Gemini, AlphaCode, and GitHub Copilot for Programmers
by: Siam, Md Kamrul, et al.
Published: (2024)

RepoMaster: Autonomous Exploration and Understanding of GitHub Repositories for Complex Task Solving
by: Wang, Huacan, et al.
Published: (2025)

Prioritising GitHub Priority Labels
by: Caddy, James, et al.
Published: (2024)

"My GitHub Sponsors profile is live!" Investigating the Impact of Twitter/X Mentions on GitHub Sponsors
by: Fan, Youmei, et al.
Published: (2024)

GitHub's Copilot Code Review: Can AI Spot Security Flaws Before You Commit?
by: Amro, Amena, et al.
Published: (2025)

Policy-driven Software Bill of Materials on GitHub: An Empirical Study
by: Novikov, Oleksii, et al.
Published: (2025)

Understanding Prompt Management in GitHub Repositories: A Call for Best Practices
by: Li, Hao, et al.
Published: (2025)

Automated Code Review Assignments: An Alternative Perspective of Code Ownership on GitHub
by: Lulla, Jai Lal, et al.
Published: (2025)

On the Use of Agentic Coding: An Empirical Study of Pull Requests on GitHub
by: Watanabe, Miku, et al.
Published: (2025)

OmniGIRL: A Multilingual and Multimodal Benchmark for GitHub Issue Resolution
by: Guo, Lianghong, et al.
Published: (2025)

On Categorizing Open Source Software Security Vulnerability Reporting Mechanisms on GitHub
by: Kancharoendee, Sushawapak, et al.
Published: (2025)

Unveiling the Role of ChatGPT in Software Development: Insights from Developer-ChatGPT Interactions on GitHub
by: Li, Ruiyin, et al.
Published: (2025)

Augmenting Software Bills of Materials with Software Vulnerability Description: A Preliminary Study on GitHub
by: Fucci, Davide, et al.
Published: (2025)

Development and Evolution of Xtext-based DSLs on GitHub: An Empirical Investigation
by: Zhang, Weixing, et al.
Published: (2025)

Is GitHub's Copilot as Bad as Humans at Introducing Vulnerabilities in Code?
by: Asare, Owura, et al.
Published: (2022)

SWE-bench-java: A GitHub Issue Resolving Benchmark for Java
by: Zan, Daoguang, et al.
Published: (2024)

Same Signal, Different Semantics: A Cross-Framework Behavioral Analysis of Software Engineering Agents
by: Ma, Wei, et al.
Published: (2026)