Cover Image

Turbulence: Systematically and Automatically Testing Instruction-Tuned Large Language Models for Code

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Honarvar, Shahin, van der Wilk, Mark, Donaldson, Alastair
Format:	Preprint
Published:	2023
Subjects:	Software Engineering Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Capture the Flags: Family-Based Evaluation of Agentic LLMs via Semantics-Preserving Transformations
by: Honarvar, Shahin, et al.
Published: (2026)

Astraios: Parameter-Efficient Instruction Tuning Code Large Language Models
by: Zhuo, Terry Yue, et al.
Published: (2024)

LIA: Supervised Fine-Tuning of Large Language Models for Automatic Issue Assignment
by: Khosravani, Arsham, et al.
Published: (2026)

WaveCoder: Widespread And Versatile Enhancement For Code Large Language Models By Instruction Tuning
by: Yu, Zhaojian, et al.
Published: (2023)

Enhancing High-Quality Code Generation in Large Language Models with Comparative Prefix-Tuning
by: Jiang, Yuan, et al.
Published: (2025)

Instruction-Tuning Open-Weight Language Models for BPMN Model Generation
by: Çelikmasat, Gökberk, et al.
Published: (2025)

ASMA-Tune: Unlocking LLMs' Assembly Code Comprehension via Structural-Semantic Instruction Tuning
by: Wang, Xinyi, et al.
Published: (2025)

PromptPex: Automatic Test Generation for Language Model Prompts
by: Sharma, Reshabh K, et al.
Published: (2025)

Automatic Qiskit Code Refactoring Using Large Language Models
by: Suárez, José Manuel, et al.
Published: (2025)

Metamorphic Testing of Deep Code Models: A Systematic Literature Review
by: Asgari, Ali, et al.
Published: (2025)

Fine-Tuning Code Language Models to Detect Cross-Language Bugs
by: Li, Zengyang, et al.
Published: (2025)

Instruction Tuning for Secure Code Generation
by: He, Jingxuan, et al.
Published: (2024)

Testing the Effect of Code Documentation on Large Language Model Code Understanding
by: Macke, William, et al.
Published: (2024)

PACIFIC: a framework for generating benchmarks to check Precise Automatically Checked Instruction Following In Code
by: Dreyfuss, Itay, et al.
Published: (2025)

Dr. Boot: Bootstrapping Program Synthesis Language Models to Perform Repairing
by: van der Vleuten, Noah
Published: (2025)

Assertion-Aware Test Code Summarization with Large Language Models
by: Mollah, Anamul Haque, et al.
Published: (2025)

CodeIF-Bench: Evaluating Instruction-Following Capabilities of Large Language Models in Interactive Code Generation
by: Wang, Peiding, et al.
Published: (2025)

Code Red! On the Harmfulness of Applying Off-the-shelf Large Language Models to Programming Tasks
by: Al-Kaswan, Ali, et al.
Published: (2025)

Evaluating Large Language Models for Code Review
by: Cihan, Umut, et al.
Published: (2025)

Traces of Memorisation in Large Language Models for Code
by: Al-Kaswan, Ali, et al.
Published: (2023)

Looking into Black Box Code Language Models
by: Haider, Muhammad Umair, et al.
Published: (2024)

Metamorphic Testing of Large Language Models for Natural Language Processing
by: Cho, Steven, et al.
Published: (2025)

Impact of Code Context and Prompting Strategies on Automated Unit Test Generation with Modern General-Purpose Large Language Models
by: Walczak, Jakub, et al.
Published: (2025)

Task Abstention for Large Language Models in Code Generation
by: Zhou, Yanke, et al.
Published: (2026)

I Can Find You in Seconds! Leveraging Large Language Models for Code Authorship Attribution
by: Choi, Soohyeon, et al.
Published: (2025)

GeoCode-GPT: A Large Language Model for Geospatial Code Generation Tasks
by: Hou, Shuyang, et al.
Published: (2024)

Augmenting Large Language Models with Static Code Analysis for Automated Code Quality Improvements
by: Abtahi, Seyed Moein, et al.
Published: (2025)

Personality-Guided Code Generation Using Large Language Models
by: Guo, Yaoqi, et al.
Published: (2024)

Large Language Model Guided Self-Debugging Code Generation
by: Adnan, Muntasir, et al.
Published: (2025)

Bugs in Large Language Models Generated Code: An Empirical Study
by: Tambon, Florian, et al.
Published: (2024)

Assessing the Code Clone Detection Capability of Large Language Models
by: Zhang, Zixian, et al.
Published: (2024)

$T^3$: Multi-level Tree-based Automatic Program Repair with Large Language Models
by: Liu, Quanming, et al.
Published: (2025)

Flow2Code: Evaluating Large Language Models for Flowchart-based Code Generation Capability
by: He, Mengliang, et al.
Published: (2025)

Large Language Models for Software Testing: A Research Roadmap
by: Augusto, Cristian, et al.
Published: (2025)

NARRepair: Non-Autoregressive Code Generation Model for Automatic Program Repair
by: Yang, Zhenyu, et al.
Published: (2024)

CodeGolf Bench: A Multi-Language Benchmark for Evaluating Concise Code Generation Capabilities of Large Language Models
by: Padwal, Vedant
Published: (2026)

Towards Leveraging Large Language Model Summaries for Topic Modeling in Source Code
by: Carissimi, Michele, et al.
Published: (2025)

Large Language Model-Driven Code Compliance Checking in Building Information Modeling
by: Madireddy, Soumya, et al.
Published: (2025)

Large Language Models for Software Engineering: A Systematic Literature Review
by: Hou, Xinyi, et al.
Published: (2023)

CrossPL: Evaluating Large Language Models on Cross Programming Language Code Generation
by: Xiong, Zhanhang, et al.
Published: (2025)