Automated Identification of Logical Errors in Programs: Advancing Scalable Analysis of Student Misconceptions

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hoq, Muntasir, Rao, Ananya, Jaishankar, Reisha, Piryani, Krish, Janapati, Nithya, Vandenberg, Jessica, Mott, Bradford, Norouzi, Narges, Lester, James, Akram, Bita
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914435623288832
author Hoq, Muntasir
Rao, Ananya
Jaishankar, Reisha
Piryani, Krish
Janapati, Nithya
Vandenberg, Jessica
Mott, Bradford
Norouzi, Narges
Lester, James
Akram, Bita
author_facet Hoq, Muntasir
Rao, Ananya
Jaishankar, Reisha
Piryani, Krish
Janapati, Nithya
Vandenberg, Jessica
Mott, Bradford
Norouzi, Narges
Lester, James
Akram, Bita
contents In Computer Science (CS) education, understanding factors contributing to students' programming difficulties is crucial for effective learning support. By identifying specific issues students face, educators can provide targeted assistance to help them overcome obstacles and improve learning outcomes. While identifying sources of struggle, such as misconceptions, in real-time can be challenging in current educational practices, analyzing logical errors in students' code can offer valuable insights. This paper presents a scalable framework for automatically detecting logical errors in students' programming solutions. Our framework is based on an explainable Abstract Syntax Tree (AST) embedding model, the Subtree-based Attention Neural Network (SANN), that identifies the structural components of programs containing logical errors. We conducted a series of experiments to evaluate its effectiveness, and the results suggest that our framework can accurately capture students' logical errors and, more importantly, provide us with deeper insights into their learning processes, offering a valuable tool for enhancing programming education.
format Preprint
id arxiv_https___arxiv_org_abs_2505_10913
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Automated Identification of Logical Errors in Programs: Advancing Scalable Analysis of Student Misconceptions
Hoq, Muntasir
Rao, Ananya
Jaishankar, Reisha
Piryani, Krish
Janapati, Nithya
Vandenberg, Jessica
Mott, Bradford
Norouzi, Narges
Lester, James
Akram, Bita
Machine Learning
K.3.1
In Computer Science (CS) education, understanding factors contributing to students' programming difficulties is crucial for effective learning support. By identifying specific issues students face, educators can provide targeted assistance to help them overcome obstacles and improve learning outcomes. While identifying sources of struggle, such as misconceptions, in real-time can be challenging in current educational practices, analyzing logical errors in students' code can offer valuable insights. This paper presents a scalable framework for automatically detecting logical errors in students' programming solutions. Our framework is based on an explainable Abstract Syntax Tree (AST) embedding model, the Subtree-based Attention Neural Network (SANN), that identifies the structural components of programs containing logical errors. We conducted a series of experiments to evaluate its effectiveness, and the results suggest that our framework can accurately capture students' logical errors and, more importantly, provide us with deeper insights into their learning processes, offering a valuable tool for enhancing programming education.
title Automated Identification of Logical Errors in Programs: Advancing Scalable Analysis of Student Misconceptions
topic Machine Learning
K.3.1
url https://arxiv.org/abs/2505.10913