Cover Image

Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Bruni, Marc, Gabrielli, Fabio, Ghafari, Mohammad, Kropp, Martin
Format:	Preprint
Published:	2025
Subjects:	Software Engineering Artificial Intelligence Cryptography and Security
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Prompting Techniques for Secure Code Generation: A Systematic Investigation
by: Tony, Catherine, et al.
Published: (2024)

DUALGUAGE: Automated Joint Security-Functionality Benchmarking for Secure Code Generation
by: Pathak, Abhijeet, et al.
Published: (2025)

Towards Secure Logging: Characterizing and Benchmarking Logging Code Security Issues with LLMs
by: Yuan, He Yang, et al.
Published: (2026)

LLM Security Guard for Code
by: Kavian, Arya, et al.
Published: (2024)

Code Security Vulnerability Repair Using Reinforcement Learning with Large Language Models
by: Islam, Nafis Tanveer, et al.
Published: (2024)

AI Code Generators for Security: Friend or Foe?
by: Natella, Roberto, et al.
Published: (2024)

Fortifying LLM-Based Code Generation with Graph-Based Reasoning on Secure Coding Practices
by: Patir, Rupam, et al.
Published: (2025)

Learning to Generate Secure Code via Token-Level Rewards
by: Quan, Jiazheng, et al.
Published: (2026)

DeepGuard: Secure Code Generation via Multi-Layer Semantic Aggregation
by: Huang, Li, et al.
Published: (2026)

Instruction Tuning for Secure Code Generation
by: He, Jingxuan, et al.
Published: (2024)

Broken by Default: A Formal Verification Study of Security Vulnerabilities in AI-Generated Code
by: Blain, Dominik, et al.
Published: (2026)

Empirical Study of Code Large Language Models for Binary Security Patch Detection
by: Li, Qingyuan, et al.
Published: (2025)

Benchmark of Benchmarks: Unpacking Influence and Code Repository Quality in LLM Safety Benchmarks
by: Chu, Junjie, et al.
Published: (2026)

Poisoning Programs by Un-Repairing Code: Security Concerns of AI-generated Code
by: Improta, Cristina
Published: (2024)

A Qualitative Study on Using ChatGPT for Software Security: Perception vs. Practicality
by: Kholoosi, M. Mehdi, et al.
Published: (2024)

Security of LLM-generated Code: A Comparative Analysis
by: Morkonda, Srivathsan G, et al.
Published: (2026)

Think Broad, Act Narrow: CWE Identification with Multi-Agent Large Language Models
by: Sayagh, Mohammed, et al.
Published: (2025)

Towards Privacy-Preserving Code Generation: Differentially Private Code Language Models
by: Catal, Melih, et al.
Published: (2025)

Measuring and Exploiting Contextual Bias in LLM-Assisted Security Code Review
by: Mitropoulos, Dimitris, et al.
Published: (2026)

From Detection to Prevention: Explaining Security-Critical Code to Avoid Vulnerabilities
by: Krishnamurthy, Ranjith, et al.
Published: (2026)

From Struggle to Simplicity with a Usable and Secure API for Encryption in Java
by: Firouzi, Ehsan, et al.
Published: (2024)

Constrained Decoding for Secure Code Generation
by: Fu, Yanjun, et al.
Published: (2024)

Beyond Trusting Trust: Multi-Model Validation for Robust Code Generation
by: McDanel, Bradley
Published: (2025)

AIBoMGen: Generating an AI Bill of Materials for Secure, Transparent, and Compliant Model Training
by: Vandendriessche, Wiebe, et al.
Published: (2026)

Investigating Detection and Obfuscation of Prompt Injection Attacks Against Software Reverse Engineering AI Agents
by: Crawford, Brian, et al.
Published: (2026)

CASTLE: Benchmarking Dataset for Static Code Analyzers and LLMs towards CWE Detection
by: Dubniczky, Richard A., et al.
Published: (2025)

The Invisible Hand: Unveiling Provider Bias in Large Language Models for Code Generation
by: Zhang, Xiaoyu, et al.
Published: (2025)

Towards Secure and Explainable Smart Contract Generation with Security-Aware Group Relative Policy Optimization
by: Yu, Lei, et al.
Published: (2025)

Secure Code Generation at Scale with Reflexion
by: Datta, Arup, et al.
Published: (2025)

KernelGPT: Enhanced Kernel Fuzzing via Large Language Models
by: Yang, Chenyuan, et al.
Published: (2023)

SecureVibeBench: Benchmarking Secure Vibe Coding of AI Agents via Reconstructing Vulnerability-Introducing Scenarios
by: Chen, Junkai, et al.
Published: (2025)

Traces of Memorisation in Large Language Models for Code
by: Al-Kaswan, Ali, et al.
Published: (2023)

MCPXKIT: The Unified Toolkit for Analyzing Model Context Protocol Security
by: Guo, Yongjian, et al.
Published: (2025)

SPDZCoder: Combining Expert Knowledge with LLMs for Generating Privacy-Computing Code
by: Dong, Xiaoning, et al.
Published: (2024)

Large Language Model Supply Chain: Open Problems From the Security Perspective
by: Hu, Qiang, et al.
Published: (2024)

LLMs + Security = Trouble
by: Livshits, Benjamin
Published: (2026)

CodeHacker: Automated Test Case Generation for Detecting Vulnerabilities in Competitive Programming Solutions
by: Shi, Jingwei, et al.
Published: (2026)

How Secure is Secure Code Generation? Adversarial Prompts Put LLM Defenses to the Test
by: Tessa, Melissa, et al.
Published: (2026)

Automated Testing of Broken Authentication Vulnerabilities in Web APIs with AuthREST
by: Corradini, Davide, et al.
Published: (2025)

Gameful Introduction to Cryptography for Dyslexic Students
by: Rahartomo, Argianto, et al.
Published: (2024)