Buchumschlag

VulnLLMEval: A Framework for Evaluating Large Language Models in Software Vulnerability Detection and Patching

Fuente: arXiv

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	Zibaeirad, Arastoo, Vieira, Marco
Format:	Preprint
Veröffentlicht:	2024
Schlagworte:	Software Engineering Artificial Intelligence
Online-Zugang:	Acceder al recurso
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Ähnliche Einträge

Reasoning with LLMs for Zero-Shot Vulnerability Detection
von: Zibaeirad, Arastoo, et al.
Veröffentlicht: (2025)

Diverse LLMs vs. Vulnerabilities: Who Detects and Fixes Them Better?
von: Zibaeirad, Arastoo, et al.
Veröffentlicht: (2025)

VulnAgent-X: A Layered Agentic Framework for Repository-Level Vulnerability Detection
von: Meng, Renwei, et al.
Veröffentlicht: (2026)

LLM4Vuln: A Unified Evaluation Framework for Decoupling and Enhancing LLMs' Vulnerability Reasoning
von: Sun, Yuqiang, et al.
Veröffentlicht: (2024)

A Systematic Literature Review on Detecting Software Vulnerabilities with Large Language Models
von: Kaniewski, Sabrina, et al.
Veröffentlicht: (2025)

MulVuln: Enhancing Pre-trained LMs with Shared and Language-Specific Knowledge for Multilingual Vulnerability Detection
von: Nguyen, Van, et al.
Veröffentlicht: (2025)

Explaining Software Vulnerabilities with Large Language Models
von: Johnson, Oshando, et al.
Veröffentlicht: (2025)

PatchFinder: A Two-Phase Approach to Security Patch Tracing for Disclosed Vulnerabilities in Open-Source Software
von: Li, Kaixuan, et al.
Veröffentlicht: (2024)

Harnessing Large Language Models for Software Vulnerability Detection: A Comprehensive Benchmarking Study
von: Tamberg, Karl, et al.
Veröffentlicht: (2024)

An Empirical Study of the Imbalance Issue in Software Vulnerability Detection
von: Guo, Yuejun, et al.
Veröffentlicht: (2026)

Learning Generalizable Multimodal Representations for Software Vulnerability Detection
von: Dong, Zeming, et al.
Veröffentlicht: (2026)

VulDetectBench: Evaluating the Deep Capability of Vulnerability Detection with Large Language Models
von: Liu, Yu, et al.
Veröffentlicht: (2024)

Vulnerability Detection: From Formal Verification to Large Language Models and Hybrid Approaches: A Comprehensive Overview
von: Tihanyi, Norbert, et al.
Veröffentlicht: (2025)

LLbezpeky: Leveraging Large Language Models for Vulnerability Detection
von: Mathews, Noble Saji, et al.
Veröffentlicht: (2024)

Toward Scalable Automated Repository-Level Datasets for Software Vulnerability Detection
von: Lbath, Amine
Veröffentlicht: (2026)

Comparison of Static Application Security Testing Tools and Large Language Models for Repo-level Vulnerability Detection
von: Zhou, Xin, et al.
Veröffentlicht: (2024)

CIAO - Code In Architecture Out - Automated Software Architecture Documentation with Large Language Models
von: De Luca, Marco, et al.
Veröffentlicht: (2026)

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities
von: Wang, Weizhe, et al.
Veröffentlicht: (2025)

EvalSVA: Multi-Agent Evaluators for Next-Gen Software Vulnerability Assessment
von: Wen, Xin-Cheng, et al.
Veröffentlicht: (2024)

Large Language Models for Software Testing: A Research Roadmap
von: Augusto, Cristian, et al.
Veröffentlicht: (2025)

Evaluating LLMs for One-Shot Patching of Real and Artificial Vulnerabilities
von: Garg, Aayush, et al.
Veröffentlicht: (2025)

Evaluating Large Language Models for Detecting Architectural Decision Violations
von: Su, Ruoyu, et al.
Veröffentlicht: (2026)

Revisiting Software Engineering Education in the Era of Large Language Models: A Curriculum Adaptation and Academic Integrity Framework
von: Degerli, Mustafa
Veröffentlicht: (2026)

Large Language Models for In-File Vulnerability Localization Can Be "Lost in the End"
von: Sovrano, Francesco, et al.
Veröffentlicht: (2025)

Large Language Model-Based Agents for Software Engineering: A Survey
von: Liu, Junwei, et al.
Veröffentlicht: (2024)

Agentic Software Issue Resolution with Large Language Models: A Survey
von: Jiang, Zhonghao, et al.
Veröffentlicht: (2025)

Large Language Models for Software Engineering: A Systematic Literature Review
von: Hou, Xinyi, et al.
Veröffentlicht: (2023)

Empirical Study of Code Large Language Models for Binary Security Patch Detection
von: Li, Qingyuan, et al.
Veröffentlicht: (2025)

Memory-Efficient Large Language Models for Program Repair with Semantic-Guided Patch Generation
von: Le-Cong, Thanh, et al.
Veröffentlicht: (2024)

Software Vulnerability and Functionality Assessment using LLMs
von: Jensen, Rasmus Ingemann Tuffveson, et al.
Veröffentlicht: (2024)

Your Instructions Are Not Always Helpful: Assessing the Efficacy of Instruction Fine-tuning for Software Vulnerability Detection
von: Yusuf, Imam Nur Bani, et al.
Veröffentlicht: (2024)

Enhancing Software Vulnerability Detection Through Adaptive Test Input Generation Using Genetic Algorithm
von: Mehendran, Yanusha, et al.
Veröffentlicht: (2025)

SCoPE: Evaluating LLMs for Software Vulnerability Detection
von: Gonçalves, José, et al.
Veröffentlicht: (2024)

Challenges in Testing Large Language Model Based Software: A Faceted Taxonomy
von: Dobslaw, Felix, et al.
Veröffentlicht: (2025)

Automating Patch Set Generation from Code Review Comments Using Large Language Models
von: Rahman, Tajmilur, et al.
Veröffentlicht: (2024)

Redefining Developer Assistance: Through Large Language Models in Software Ecosystem
von: Banerjee, Somnath, et al.
Veröffentlicht: (2023)

Evaluating Software Development Agents: Patch Patterns, Code Quality, and Issue Complexity in Real-World GitHub Scenarios
von: Chen, Zhi, et al.
Veröffentlicht: (2024)

Bridging Semantics & Structure for Software Vulnerability Detection using Hybrid Network Models
von: Gajjar, Jugal, et al.
Veröffentlicht: (2025)

From Patches to Trajectories: Privileged Process Supervision for Software-Engineering Agents
von: Ma, Murong, et al.
Veröffentlicht: (2026)

RePaCA: Leveraging Reasoning Large Language Models for Static Automated Patch Correctness Assessment
von: Fuster-Pena, Marcos, et al.
Veröffentlicht: (2025)