Cover Image

LLM-itation is the Sincerest Form of Data: Generating Synthetic Buggy Code Submissions for Computing Education

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Leinonen, Juho, Denny, Paul, Kiljunen, Olli, MacNeil, Stephen, Sarsa, Sami, Hellas, Arto
Format:	Preprint
Published:	2024
Subjects:	Computers and Society Software Engineering
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Comparing Code Explanations Created by Students and Large Language Models
by: Leinonen, Juho, et al.
Published: (2023)

Benchmarking Educational Program Repair
by: Koutcheme, Charles, et al.
Published: (2024)

Synthetic Students: A Comparative Study of Bug Distribution Between Large Language Models and Computing Students
by: MacNeil, Stephen, et al.
Published: (2024)

Using Large Language Models to Enhance Programming Error Messages
by: Leinonen, Juho, et al.
Published: (2022)

"Like a Nesting Doll": Analyzing Recursion Analogies Generated by CS Students using Large Language Models
by: Bernstein, Seth, et al.
Published: (2024)

Open Source Language Models Can Provide Feedback: Evaluating LLMs' Ability to Help Students Using GPT-4-As-A-Judge
by: Koutcheme, Charles, et al.
Published: (2024)

Evaluating Contextually Personalized Programming Exercises Created with Generative AI
by: Logacheva, Evanfiya, et al.
Published: (2024)

Evaluating Language Models for Generating and Judging Programming Feedback
by: Koutcheme, Charles, et al.
Published: (2024)

"Sometimes You Just Gotta Risk It for the Biscuit": A Portrait of Student Risk-Taking
by: Leinonen, Juho, et al.
Published: (2024)

Teaching Language Models How to Code Like Learners: Conversational Serialization for Student Simulation
by: Koutcheme, Charles, et al.
Published: (2026)

Overview of Web Application Performance Optimization Techniques
by: Vepsäläinen, Juho, et al.
Published: (2024)

The Role of Generative AI in Software Student CollaborAItion
by: Kiesler, Natalie, et al.
Published: (2025)

AI-Generated Slides: Are They Good? Can Students Tell?
by: Leinonen, Juho, et al.
Published: (2026)

On the Opportunities of Large Language Models for Programming Process Data
by: Edwards, John, et al.
Published: (2024)

Experiences from Integrating Large Language Model Chatbots into the Classroom
by: Hellas, Arto, et al.
Published: (2024)

Probing the Unknown: Exploring Student Interactions with Probeable Problems at Scale in Introductory Programming
by: Denny, Paul, et al.
Published: (2025)

Personalized Worked Example Generation from Student Code Submissions Using Pattern-based Knowledge Components
by: Pitts, Griffin, et al.
Published: (2026)

Explaining Code with a Purpose: An Integrated Approach for Developing Code Comprehension and Prompting Skills
by: Denny, Paul, et al.
Published: (2024)

Locating Buggy Segments in Quantum Program Debugging
by: Sato, Naoto, et al.
Published: (2023)

Can We Improve Educational Diagram Generation with In-Context Examples? Not if a Hallucination Spoils the Bunch
by: Logacheva, Evanfiya, et al.
Published: (2026)

The Missing Evaluation Axis: What 10,000 Student Submissions Reveal About AI Tutor Effectiveness
by: Niousha, Rose, et al.
Published: (2026)

Detecting Buggy Contracts via Smart Testing
by: Wang, Sally Junsong, et al.
Published: (2024)

Systematically Thinking about the Complexity of Code Structuring Exercises at Introductory Level
by: Haldeman, Georgiana, et al.
Published: (2025)

Toward the Automated Localization of Buggy Mobile App UIs from Bug Descriptions
by: Saha, Antu, et al.
Published: (2024)

Prompts First, Finally
by: Reeves, Brent N., et al.
Published: (2024)

Integrating Natural Language Prompting Tasks in Introductory Programming Courses
by: Kerslake, Chris, et al.
Published: (2024)

BugSpotter: Automated Generation of Code Debugging Exercises
by: Pădurean, Victor-Alexandru, et al.
Published: (2024)

Imagining Computing Education Assessment after Generative AI
by: MacNeil, Stephen, et al.
Published: (2024)

Teaching Program Decomposition in CS1: A Conceptual Framework for Improved Code Quality
by: Haldeman, Georgiana, et al.
Published: (2024)

From Prompts to Propositions: A Logic-Based Lens on Student-LLM Interactions
by: Alfageeh, Ali, et al.
Published: (2025)

Desirable Characteristics for AI Teaching Assistants in Programming Education
by: Denny, Paul, et al.
Published: (2024)

An Approach to Detect Abnormal Submissions for CodeWorkout Dataset
by: Hicks, Alex, et al.
Published: (2024)

Beyond the Hype: A Comprehensive Review of Current Trends in Generative AI Research, Teaching Practices, and Tools
by: Prather, James, et al.
Published: (2024)

Counting the Trees in the Forest: Evaluating Prompt Segmentation for Classifying Code Comprehension Level
by: Smith IV, David H., et al.
Published: (2025)

Improving Assignment Submission in Higher Education through a Git-Enabled System: An Iterative Case Study
by: Babatunde, Ololade, et al.
Published: (2025)

A Picture Is Worth a Thousand Words: Exploring Diagram and Video-Based OOP Exercises to Counter LLM Over-Reliance
by: Cipriano, Bruno Pereira, et al.
Published: (2024)

Fault Localization for Buggy Deep Learning Framework Conversions in Image Recognition
by: Louloudakis, Nikolaos, et al.
Published: (2023)

Narrowing the Gap: Supervised Fine-Tuning of Open-Source LLMs as a Viable Alternative to Proprietary Models for Pedagogical Tools
by: Solano, Lorenzo Lee, et al.
Published: (2025)

RLearner-LLM: Balancing Logical Grounding and Fluency in Large Language Models via Hybrid Direct Preference Optimization
by: Bao, Qiming, et al.
Published: (2026)

Uncovering LLM-Generated Code: A Zero-Shot Synthetic Code Detector via Code Rewriting
by: Ye, Tong, et al.
Published: (2024)