Retrieval-Augmented Tutoring for Algorithm Tracing and Problem-Solving in AI Education

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Jain, Mragisha, Bhatt, Tirth, Pitts, Griffin, Pandya, Aum, Brusilovsky, Peter, Norouzi, Narges, Hellas, Arto, Leinonen, Juho, Akram, Bita
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910215464550400
author Jain, Mragisha
Bhatt, Tirth
Pitts, Griffin
Pandya, Aum
Brusilovsky, Peter
Norouzi, Narges
Hellas, Arto
Leinonen, Juho
Akram, Bita
author_facet Jain, Mragisha
Bhatt, Tirth
Pitts, Griffin
Pandya, Aum
Brusilovsky, Peter
Norouzi, Narges
Hellas, Arto
Leinonen, Juho
Akram, Bita
contents Students learning algorithms often need support as they interpret traces, debug reasoning errors, and apply procedures across unfamiliar problem instances. In this paper, we present KITE (Knowledge-Informed Tutoring Engine), a Retrieval-Augmented Generation (RAG)-based intelligent tutoring system designed to serve as a classroom teaching assistant for algorithmic reasoning and problem-solving tasks. KITE uses an intent-aware Socratic response strategy to tailor support to different student needs, responding with targeted hints, guiding questions, and progressive scaffolding intended to strengthen students' algorithmic problem-solving ability. To keep responses aligned with course content, KITE uses a multimodal RAG pipeline that retrieves relevant information from course materials. We evaluate KITE using three forms of assessment: RAGAs-based metrics for response grounding and quality, expert evaluation of pedagogical quality, and a simulated student pipeline in which a weaker language model interacts with KITE across two-turn dialogues and produces revised answers after receiving feedback. Results indicate that KITE produces contextually grounded and pedagogically appropriate responses. Further, using simulated students, KITE's feedback helped the student models produce more accurate follow-up responses on procedural and tracing questions, suggesting that its scaffolding can support algorithmic problem-solving. This work contributes a tutoring architecture and an evaluation approach for assessing retrieval-grounded explanations and scaffolded problem-solving feedback.
format Preprint
id arxiv_https___arxiv_org_abs_2605_12988
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Retrieval-Augmented Tutoring for Algorithm Tracing and Problem-Solving in AI Education
Jain, Mragisha
Bhatt, Tirth
Pitts, Griffin
Pandya, Aum
Brusilovsky, Peter
Norouzi, Narges
Hellas, Arto
Leinonen, Juho
Akram, Bita
Artificial Intelligence
Computers and Society
Information Retrieval
Students learning algorithms often need support as they interpret traces, debug reasoning errors, and apply procedures across unfamiliar problem instances. In this paper, we present KITE (Knowledge-Informed Tutoring Engine), a Retrieval-Augmented Generation (RAG)-based intelligent tutoring system designed to serve as a classroom teaching assistant for algorithmic reasoning and problem-solving tasks. KITE uses an intent-aware Socratic response strategy to tailor support to different student needs, responding with targeted hints, guiding questions, and progressive scaffolding intended to strengthen students' algorithmic problem-solving ability. To keep responses aligned with course content, KITE uses a multimodal RAG pipeline that retrieves relevant information from course materials. We evaluate KITE using three forms of assessment: RAGAs-based metrics for response grounding and quality, expert evaluation of pedagogical quality, and a simulated student pipeline in which a weaker language model interacts with KITE across two-turn dialogues and produces revised answers after receiving feedback. Results indicate that KITE produces contextually grounded and pedagogically appropriate responses. Further, using simulated students, KITE's feedback helped the student models produce more accurate follow-up responses on procedural and tracing questions, suggesting that its scaffolding can support algorithmic problem-solving. This work contributes a tutoring architecture and an evaluation approach for assessing retrieval-grounded explanations and scaffolded problem-solving feedback.
title Retrieval-Augmented Tutoring for Algorithm Tracing and Problem-Solving in AI Education
topic Artificial Intelligence
Computers and Society
Information Retrieval
url https://arxiv.org/abs/2605.12988