DebugTA: An LLM-Based Agent for Simplifying Debugging and Teaching in Programming Education

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Fu, Lingyue, Yuan, Haowei, Chen, Datong, Dai, Xinyi, Li, Qingyao, Zhang, Weinan, Liu, Weiwen, Yu, Yong
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917007561064448
author Fu, Lingyue
Yuan, Haowei
Chen, Datong
Dai, Xinyi
Li, Qingyao
Zhang, Weinan
Liu, Weiwen
Yu, Yong
author_facet Fu, Lingyue
Yuan, Haowei
Chen, Datong
Dai, Xinyi
Li, Qingyao
Zhang, Weinan
Liu, Weiwen
Yu, Yong
contents In programming education, Debugging and Teaching (DT) task is a common scenario where students receive assistance in correcting their erroneous code. The task involves multiple inputs, including erroneous code, error messages, reference solutions, and the question description, with the goal of generating modification suggestions to the erroneous code. However, two key challenges hinder the effectiveness of existing approaches. Firstly, the complexity and heterogeneity of inputs inherent in DT tasks significantly elevate the reasoning challenges faced by LLMs. Second, existing approaches often fail to fully leverage the availability of standard code in DT tasks, forcing models to rely solely on complex multi-step reasoning, which limits the potential of LLMs in addressing DT tasks effectively. To address these challenges, we propose DebugTA, a novel LLM-based debugging and teaching agent with specialized tools for standard code retrieval, variable substitution to align reference code, and an external compiler for real-time code analysis. Guided by explicit pedagogical and debugging principles, DebugTA acts as an agent that decomposes a complex task into sequential LLM interactions, each utilizing distinct tools for specific subtasks, thereby simplifying the logical reasoning at each step and reducing overall reasoning complexity. Furthermore, DebugTA utilizes tool calls to align the standard code with the erroneous code as much as possible, allowing the LLM to focus on logic errors within the erroneous code and improving the accuracy of the generated suggestions. To rigorously assess the quality of modification suggestions, we introduce a student simulator-teacher interaction paradigm. Experimental results on three real-world code datasets demonstrate that DebugTA consistently improves teaching effectiveness while significantly reducing computational costs.
format Preprint
id arxiv_https___arxiv_org_abs_2510_11076
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DebugTA: An LLM-Based Agent for Simplifying Debugging and Teaching in Programming Education
Fu, Lingyue
Yuan, Haowei
Chen, Datong
Dai, Xinyi
Li, Qingyao
Zhang, Weinan
Liu, Weiwen
Yu, Yong
Software Engineering
In programming education, Debugging and Teaching (DT) task is a common scenario where students receive assistance in correcting their erroneous code. The task involves multiple inputs, including erroneous code, error messages, reference solutions, and the question description, with the goal of generating modification suggestions to the erroneous code. However, two key challenges hinder the effectiveness of existing approaches. Firstly, the complexity and heterogeneity of inputs inherent in DT tasks significantly elevate the reasoning challenges faced by LLMs. Second, existing approaches often fail to fully leverage the availability of standard code in DT tasks, forcing models to rely solely on complex multi-step reasoning, which limits the potential of LLMs in addressing DT tasks effectively. To address these challenges, we propose DebugTA, a novel LLM-based debugging and teaching agent with specialized tools for standard code retrieval, variable substitution to align reference code, and an external compiler for real-time code analysis. Guided by explicit pedagogical and debugging principles, DebugTA acts as an agent that decomposes a complex task into sequential LLM interactions, each utilizing distinct tools for specific subtasks, thereby simplifying the logical reasoning at each step and reducing overall reasoning complexity. Furthermore, DebugTA utilizes tool calls to align the standard code with the erroneous code as much as possible, allowing the LLM to focus on logic errors within the erroneous code and improving the accuracy of the generated suggestions. To rigorously assess the quality of modification suggestions, we introduce a student simulator-teacher interaction paradigm. Experimental results on three real-world code datasets demonstrate that DebugTA consistently improves teaching effectiveness while significantly reducing computational costs.
title DebugTA: An LLM-Based Agent for Simplifying Debugging and Teaching in Programming Education
topic Software Engineering
url https://arxiv.org/abs/2510.11076