Automated Program Repair of Uncompilable Student Code

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Pitts, Griffin, Pandya, Aum, Rank, Darsh, Bhatt, Tirth, Hoq, Muntasir, Akram, Bita
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917165162037248
author Pitts, Griffin
Pandya, Aum
Rank, Darsh
Bhatt, Tirth
Hoq, Muntasir
Akram, Bita
author_facet Pitts, Griffin
Pandya, Aum
Rank, Darsh
Bhatt, Tirth
Hoq, Muntasir
Akram, Bita
contents A significant portion of student programming submissions in CS1 learning environments are uncompilable, limiting their use in student modeling and downstream knowledge tracing. Traditional modeling pipelines often exclude these cases, discarding observations of student learning. This study investigates automated program repair as a strategy to recover uncompilable code while preserving students' structural intent for use in student modeling. Within this framework, we assess large language models (LLMs) as repair agents under high- and low-context prompting conditions. Repairs were evaluated for compilability, edit distance, and preservation of students' original structure and logic. While all models produced compilable repairs, they differed in how well they preserve students' control flow and code structure, affecting their pedagogical utility. By recovering uncompilable submissions, this work enables richer and more comprehensive analyses of learners' coding processes and development over time.
format Preprint
id arxiv_https___arxiv_org_abs_2510_06187
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Automated Program Repair of Uncompilable Student Code
Pitts, Griffin
Pandya, Aum
Rank, Darsh
Bhatt, Tirth
Hoq, Muntasir
Akram, Bita
Software Engineering
Artificial Intelligence
Computers and Society
A significant portion of student programming submissions in CS1 learning environments are uncompilable, limiting their use in student modeling and downstream knowledge tracing. Traditional modeling pipelines often exclude these cases, discarding observations of student learning. This study investigates automated program repair as a strategy to recover uncompilable code while preserving students' structural intent for use in student modeling. Within this framework, we assess large language models (LLMs) as repair agents under high- and low-context prompting conditions. Repairs were evaluated for compilability, edit distance, and preservation of students' original structure and logic. While all models produced compilable repairs, they differed in how well they preserve students' control flow and code structure, affecting their pedagogical utility. By recovering uncompilable submissions, this work enables richer and more comprehensive analyses of learners' coding processes and development over time.
title Automated Program Repair of Uncompilable Student Code
topic Software Engineering
Artificial Intelligence
Computers and Society
url https://arxiv.org/abs/2510.06187