Cover Image

Code Roulette: How Prompt Variability Affects LLM Code Generation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Paleyes, Andrei, Sendyka, Radzim, Robinson, Diana, Cabrera, Christian, Lawrence, Neil D.
Format:	Preprint
Published:	2025
Subjects:	Software Engineering Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

LLM Performance for Code Generation on Noisy Tasks
by: Sendyka, Radzim, et al.
Published: (2025)

Machine Learning Systems: A Survey from a Data-Oriented Perspective
by: Cabrera, Christian, et al.
Published: (2023)

Optimising for Energy Efficiency and Performance in Machine Learning
by: Ferreira, Emile Dos Santos, et al.
Published: (2026)

Self-sustaining Software Systems (S4): Towards Improved Interpretability and Adaptation
by: Cabrera, Christian, et al.
Published: (2024)

Co-Located Tests, Better AI Code: How Test Syntax Structure Affects Foundation Model Code Generation
by: Jacopin, Éric
Published: (2026)

Code-Aware Prompting: A study of Coverage Guided Test Generation in Regression Setting using LLM
by: Ryan, Gabriel, et al.
Published: (2024)

Code Less, Align More: Efficient LLM Fine-tuning for Code Generation with Data Pruning
by: Tsai, Yun-Da, et al.
Published: (2024)

How Efficient is LLM-Generated Code? A Rigorous & High-Standard Benchmark
by: Qiu, Ruizhong, et al.
Published: (2024)

SemRep: Generative Code Representation Learning with Code Transformations
by: Li, Weichen, et al.
Published: (2026)

Automatic Semantic Augmentation of Language Model Prompts (for Code Summarization)
by: Ahmed, Toufique, et al.
Published: (2023)

Prompt-Driven Code Summarization: A Systematic Literature Review
by: Farjana, Afia, et al.
Published: (2026)

Leveraging LLMs for Legacy Code Modernization: Challenges and Opportunities for LLM-Generated Documentation
by: Diggs, Colin, et al.
Published: (2024)

Enhancing Code Quality with Generative AI: Boosting Developer Warning Compliance
by: Chang, Hansen, et al.
Published: (2025)

PromSec: Prompt Optimization for Secure Generation of Functional Source Code with Large Language Models (LLMs)
by: Nazzal, Mahmoud, et al.
Published: (2024)

Think Anywhere in Code Generation
by: Jiang, Xue, et al.
Published: (2026)

CodeIF: Benchmarking the Instruction-Following Capabilities of Large Language Models for Code Generation
by: Yan, Kaiwen, et al.
Published: (2025)

Breaking Memorization Barriers in LLM Code Fine-Tuning via Information Bottleneck for Improved Generalization
by: Wang, Changsheng, et al.
Published: (2025)

A Survey on LLM-based Code Generation for Low-Resource and Domain-Specific Programming Languages
by: Joel, Sathvik, et al.
Published: (2024)

Selective Prompt Anchoring for Code Generation
by: Tian, Yuan, et al.
Published: (2024)

Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineering
by: Ridnik, Tal, et al.
Published: (2024)

An Initial Exploration of Contrastive Prompt Tuning to Generate Energy-Efficient Code
by: Weidmann, Sophie, et al.
Published: (2026)

Wisdom and Delusion of LLM Ensembles for Code Generation and Repair
by: Vallecillos-Ruiz, Fernando, et al.
Published: (2025)

Renaissance of Literate Programming in the Era of LLMs: Enhancing LLM-Based Code Generation in Large-Scale Projects
by: Zhang, Wuyang, et al.
Published: (2024)

OSS-Bench: Benchmark Generator for Coding LLMs
by: Jiang, Yuancheng, et al.
Published: (2025)

Enhancing LLM-Based Test Generation by Eliminating Covered Code
by: Xu, WeiZhe, et al.
Published: (2026)

Semantic Voting: Execution-Grounded Consensus for LLM Code Generation
by: Jiang, Shan, et al.
Published: (2026)

CodeSAM: Source Code Representation Learning by Infusing Self-Attention with Multi-Code-View Graphs
by: Mathai, Alex, et al.
Published: (2024)

NaturalCodeBench: Examining Coding Performance Mismatch on HumanEval and Natural User Prompts
by: Zhang, Shudan, et al.
Published: (2024)

StructCoder: Structure-Aware Transformer for Code Generation
by: Tipirneni, Sindhu, et al.
Published: (2022)

Leveraging Reviewer Experience in Code Review Comment Generation
by: Lin, Hong Yi, et al.
Published: (2024)

Prompting and Fine-tuning Large Language Models for Automated Code Review Comment Generation
by: Haider, Md. Asif, et al.
Published: (2024)

IntentCoding: Amplifying User Intent in Code Generation
by: Fang, Zheng, et al.
Published: (2026)

SelfCodeAlign: Self-Alignment for Code Generation
by: Wei, Yuxiang, et al.
Published: (2024)

Leveraging Reward Models for Guiding Code Review Comment Generation
by: Sghaier, Oussama Ben, et al.
Published: (2025)

Ensuring Functional Correctness of Large Code Models with Selective Generation
by: Jeong, Jaewoo, et al.
Published: (2025)

CWEval: Outcome-driven Evaluation on Functionality and Security of LLM Code Generation
by: Peng, Jinjun, et al.
Published: (2025)

Carbon Footprint Evaluation of Code Generation through LLM as a Service
by: Vartziotis, Tina, et al.
Published: (2025)

Domain-Adaptable Reinforcement Learning for Code Generation with Dense Rewards
by: Jolfaei, Erfan Aghadavoodi, et al.
Published: (2026)

FRANC: A Lightweight Framework for High-Quality Code Generation
by: Siddiq, Mohammed Latif, et al.
Published: (2023)

Design-Specification Tiling for ICL-based CAD Code Generation
by: Du, Yali, et al.
Published: (2026)