Cover Image

Evaluating LLMs for One-Shot Patching of Real and Artificial Vulnerabilities

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Garg, Aayush, Khan, Zanis Ali, Degiovanni, Renzo, Tang, Qiang
Format:	Preprint
Published:	2025
Subjects:	Cryptography and Security Artificial Intelligence Software Engineering
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Multi-Dataset Evaluation of Models for Automated Vulnerability Repair
by: Khan, Zanis Ali, et al.
Published: (2025)

Evaluating Pre-Trained Models for Multi-Language Vulnerability Patching
by: Khan, Zanis Ali, et al.
Published: (2025)

PATCHEVAL: A New Benchmark for Evaluating LLMs on Patching Real-World Vulnerabilities
by: Wei, Zichao, et al.
Published: (2025)

Explainable Vulnerability Detection in C/C++ Using Edge-Aware Graph Attention Networks
by: Haque, Radowanul, et al.
Published: (2025)

LLM4Vuln: A Unified Evaluation Framework for Decoupling and Enhancing LLMs' Vulnerability Reasoning
by: Sun, Yuqiang, et al.
Published: (2024)

Harnessing the Power of LLMs in Source Code Vulnerability Detection
by: Mahyari, Andrew A
Published: (2024)

Co-PatcheR: Collaborative Software Patching with Component(s)-specific Small Reasoning Models
by: Tang, Yuheng, et al.
Published: (2025)

Retrieval-Augmented Few-Shot Prompting Versus Fine-Tuning for Code Vulnerability Detection
by: Trad, Fouad, et al.
Published: (2025)

SCoPE: Evaluating LLMs for Software Vulnerability Detection
by: Gonçalves, José, et al.
Published: (2024)

Detecting Data Poisoning in Code Generation LLMs via Black-Box, Vulnerability-Oriented Scanning
by: Yan, Shenao, et al.
Published: (2026)

CoDe-R: Refining Decompiler Output with LLMs via Rationale Guidance and Adaptive Inference
by: Zhang, Qiang, et al.
Published: (2026)

VulDetectBench: Evaluating the Deep Capability of Vulnerability Detection with Large Language Models
by: Liu, Yu, et al.
Published: (2024)

Data and Context Matter: Towards Generalizing AI-based Software Vulnerability Detection
by: Safdar, Rijha, et al.
Published: (2025)

Chimera: Harnessing Multi-Agent LLMs for Automatic Insider Threat Simulation
by: Yu, Jiongchi, et al.
Published: (2025)

An Empirical Study of Vulnerabilities in Python Packages and Their Detection
by: Quan, Haowei, et al.
Published: (2025)

Repository-Level Graph Representation Learning for Enhanced Security Patch Detection
by: Wen, Xin-Cheng, et al.
Published: (2024)

Beyond Classification: Evaluating LLMs for Fine-Grained Automatic Malware Behavior Auditing
by: Zheng, Xinran, et al.
Published: (2025)

Detecting Vulnerabilities from Issue Reports for Internet-of-Things
by: Masoumzadeh, Sogol
Published: (2025)

LLbezpeky: Leveraging Large Language Models for Vulnerability Detection
by: Mathews, Noble Saji, et al.
Published: (2024)

An Empirical Study of Vulnerability Detection using Federated Learning
by: Zhou, Peiheng, et al.
Published: (2024)

Favia: Forensic Agent for Vulnerability-fix Identification and Analysis
by: Storhaug, André, et al.
Published: (2026)

How Effective Are Neural Networks for Fixing Security Vulnerabilities
by: Wu, Yi, et al.
Published: (2023)

Empirical Study of Code Large Language Models for Binary Security Patch Detection
by: Li, Qingyuan, et al.
Published: (2025)

MOSAIC-Bench: Measuring Compositional Vulnerability Induction in Coding Agents
by: Steinberg, Jonathan, et al.
Published: (2026)

Graph Neural Networks for Vulnerability Detection: A Counterfactual Explanation
by: Chu, Zhaoyang, et al.
Published: (2024)

Toward Patch Robustness Certification and Detection for Deep Learning Systems Beyond Consistent Samples
by: Zhou, Qilin, et al.
Published: (2025)

VULPO: Context-Aware Vulnerability Detection via On-Policy LLM Optimization
by: Li, Youpeng, et al.
Published: (2025)

From Detection to Prevention: Explaining Security-Critical Code to Avoid Vulnerabilities
by: Krishnamurthy, Ranjith, et al.
Published: (2026)

Needles at Scale: LLM-Assisted Target Selection for Windows Vulnerability Research
by: Bommarito II, Michael J.
Published: (2026)

Knowdit: Agentic Smart Contract Vulnerability Detection with Auditing Knowledge Summarization
by: Kong, Ziqiao, et al.
Published: (2026)

PatUntrack: Automated Generating Patch Examples for Issue Reports without Tracked Insecure Code
by: Jiang, Ziyou, et al.
Published: (2024)

CrossCert: A Cross-Checking Detection Approach to Patch Robustness Certification for Deep Learning Models
by: Zhou, Qilin, et al.
Published: (2024)

A Comprehensive Study of Exploitable Patterns in Smart Contracts: From Vulnerability to Defense
by: Ding, Yuchen, et al.
Published: (2025)

Bridging Semantics & Structure for Software Vulnerability Detection using Hybrid Network Models
by: Gajjar, Jugal, et al.
Published: (2025)

MAVUL: Multi-Agent Vulnerability Detection via Contextual Reasoning and Interactive Refinement
by: Li, Youpeng, et al.
Published: (2025)

Focus on What Matters: Fisher-Guided Adaptive Multimodal Fusion for Vulnerability Detection
by: Bian, Yun, et al.
Published: (2026)

Code Security Vulnerability Repair Using Reinforcement Learning with Large Language Models
by: Islam, Nafis Tanveer, et al.
Published: (2024)

GPTScan: Detecting Logic Vulnerabilities in Smart Contracts by Combining GPT with Program Analysis
by: Sun, Yuqiang, et al.
Published: (2023)

QLPro: Automated Code Vulnerability Discovery via LLM and Static Code Analysis Integration
by: Hu, Junze, et al.
Published: (2025)

Harnessing Large Language Models for Software Vulnerability Detection: A Comprehensive Benchmarking Study
by: Tamberg, Karl, et al.
Published: (2024)