Cover Image

Defects4C: Benchmarking Large Language Model Repair Capability with C/C++ Bugs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Jian, Xie, Xiaofei, Hu, Qiang, Liu, Shangqing, Yu, Jiongchi, Kong, Jiaolong, Li, Yi
Format:	Preprint
Published:	2025
Subjects:	Software Engineering
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ContrastRepair: Enhancing Conversation-Based Automated Program Repair via Contrastive Test Case Pairs
by: Kong, Jiaolong, et al.
Published: (2024)

Do Code Semantics Help? A Comprehensive Study on Execution Trace-Based Information for Code Large Language Models
by: Wang, Jian, et al.
Published: (2025)

Enhancing Automated Program Repair via Faulty Token Localization and Quality-Aware Patch Refinement
by: Kong, Jiaolong, et al.
Published: (2025)

SpecGen: Automated Generation of Formal Program Specifications via Large Language Models
by: Ma, Lezhi, et al.
Published: (2024)

Understanding the Supply Chain and Risks of Large Language Model Applications
by: Ma, Yujie, et al.
Published: (2025)

The Foundation Cracks: A Comprehensive Study on Bugs and Testing Practices in LLM Libraries
by: Jiang, Weipeng, et al.
Published: (2025)

A Deep Dive into Large Language Models for Automated Bug Localization and Repair
by: Hossain, Soneya Binta, et al.
Published: (2024)

Chimera: Harnessing Multi-Agent LLMs for Automatic Insider Threat Simulation
by: Yu, Jiongchi, et al.
Published: (2025)

AutoEmpirical: LLM-Based Automated Research for Empirical Software Fault Analysis
by: Yu, Jiongchi, et al.
Published: (2025)

Human in the Loop for Fuzz Testing: Literature Review and the Road Ahead
by: Yu, Jiongchi, et al.
Published: (2026)

CAShift: Benchmarking Log-Based Cloud Attack Detection under Normality Shift
by: Yu, Jiongchi, et al.
Published: (2025)

Automated Repair of C Programs Using Large Language Models
by: Farzandway, Mahdi, et al.
Published: (2025)

Leveraging LLM Agents for Automated Video Game Testing
by: Wang, Chengjia, et al.
Published: (2025)

CMind: An AI Agent for Localizing C Memory Bugs
by: Su, Chia-Yi, et al.
Published: (2026)

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities
by: Wang, Weizhe, et al.
Published: (2025)

Intention is All You Need: Refining Your Code from Your Intention
by: Guo, Qi, et al.
Published: (2025)

LLM-CompDroid: Repairing Configuration Compatibility Bugs in Android Apps with Pre-trained Large Language Models
by: Liu, Zhijie, et al.
Published: (2024)

Improving MPI Error Detection and Repair with Large Language Models and Bug References
by: Piersall, Scott, et al.
Published: (2026)

ARGUS: Defending LLM Agents Against Context-Aware Prompt Injection
by: Weng, Shihao, et al.
Published: (2026)

Unveiling Code Pre-Trained Models: Investigating Syntax and Semantics Capacities
by: Ma, Wei, et al.
Published: (2022)

VulStamp: Vulnerability Assessment using Large Language Model
by: Shen, Hao, et al.
Published: (2025)

Human Attention During Localization of Memory Bugs in C Programs
by: Smith, Emory, et al.
Published: (2025)

From Bugs to Benchmarks: A Comprehensive Survey of Software Defect Datasets
by: Zhu, Hao-Nan, et al.
Published: (2025)

Towards Understanding Bugs in Distributed Training and Inference Frameworks for Large Language Models
by: Yu, Xiao, et al.
Published: (2025)

Challenging Bug Prediction and Repair Models with Synthetic Bugs
by: Ibrahimzada, Ali Reza, et al.
Published: (2023)

LLMs are Bug Replicators: An Empirical Study on LLMs' Capability in Completing Bug-prone Code
by: Guo, Liwei, et al.
Published: (2025)

SiblingRepair: Sibling-Based Multi-Hunk Repair with Large Language Models
by: Liu, Xinyu, et al.
Published: (2026)

Are Large Language Models Memorizing Bug Benchmarks?
by: Ramos, Daniel, et al.
Published: (2024)

HAFix: History-Augmented Large Language Models for Bug Fixing
by: Shi, Yu, et al.
Published: (2025)

Large Language Model Supply Chain: Open Problems From the Security Perspective
by: Hu, Qiang, et al.
Published: (2024)

Exploring Large Language Models in Resolving Environment-Related Crash Bugs: Localizing and Repairing
by: Du, Xueying, et al.
Published: (2023)

SpecEval: Evaluating Code Comprehension in Large Language Models via Program Specifications
by: Ma, Lezhi, et al.
Published: (2024)

Repair Ingredients Are All You Need: Improving Large Language Model-Based Program Repair via Repair Ingredients Search
by: Zhang, Jiayi, et al.
Published: (2025)

Rethinking the Capability of Fine-Tuned Language Models for Automated Vulnerability Repair
by: Han, Woorim, et al.
Published: (2025)

Improving Compiler Bug Isolation by Leveraging Large Language Models
by: Qi, Yixian, et al.
Published: (2025)

Adversarial Bug Reports as a Security Risk in Language Model-Based Automated Program Repair
by: Przymus, Piotr, et al.
Published: (2025)

Exploring the Capabilities of Vision-Language Models to Detect Visual Bugs in HTML5 <canvas> Applications
by: Macklon, Finlay, et al.
Published: (2025)

FeedbackEval: A Benchmark for Evaluating Large Language Models in Feedback-Driven Code Repair Tasks
by: Dai, Dekun, et al.
Published: (2025)

Towards Demystifying and Repairing LLM-in-the-Loop Vulnerabilities
by: Ma, Yujie, et al.
Published: (2026)

A Real-World Benchmark for Evaluating Fine-Grained Issue Solving Capabilities of Large Language Models
by: Hu, Ruida, et al.
Published: (2024)