Tracing Mathematical Proficiency Through Problem-Solving Processes

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Park, Jungyang, Kang, Suho, Park, Jaewoo, Kim, Jaehong, Shin, Jaewoo, Park, Seonjoon, Yu, Youngjae
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917226647388160
author Park, Jungyang
Kang, Suho
Park, Jaewoo
Kim, Jaehong
Shin, Jaewoo
Park, Seonjoon
Yu, Youngjae
author_facet Park, Jungyang
Kang, Suho
Park, Jaewoo
Kim, Jaehong
Shin, Jaewoo
Park, Seonjoon
Yu, Youngjae
contents Knowledge Tracing (KT) aims to model student's knowledge state and predict future performance to enable personalized learning in Intelligent Tutoring Systems. However, traditional KT methods face fundamental limitations in explainability, as they rely solely on the response correctness, neglecting the rich information embedded in students' problem-solving processes. To address this gap, we propose Knowledge Tracing Leveraging Problem-Solving Process (KT-PSP), which incorporates students' problem-solving processes to capture the multidimensional aspects of mathematical proficiency. We also introduce KT-PSP-25, a new dataset specifically designed for the KT-PSP. Building on this, we present StatusKT, a KT framework that employs a teacher-student-teacher three-stage LLM pipeline to extract students' MP as intermediate signals. In this pipeline, the teacher LLM first extracts problem-specific proficiency indicators, then a student LLM generates responses based on the student's solution process, and a teacher LLM evaluates these responses to determine mastery of each indicator. The experimental results on KT-PSP-25 demonstrate that StatusKT improves the prediction performance of existing KT methods. Moreover, StatusKT provides interpretable explanations for its predictions by explicitly modeling students' mathematical proficiency.
format Preprint
id arxiv_https___arxiv_org_abs_2512_00311
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Tracing Mathematical Proficiency Through Problem-Solving Processes
Park, Jungyang
Kang, Suho
Park, Jaewoo
Kim, Jaehong
Shin, Jaewoo
Park, Seonjoon
Yu, Youngjae
Machine Learning
Artificial Intelligence
Computers and Society
Knowledge Tracing (KT) aims to model student's knowledge state and predict future performance to enable personalized learning in Intelligent Tutoring Systems. However, traditional KT methods face fundamental limitations in explainability, as they rely solely on the response correctness, neglecting the rich information embedded in students' problem-solving processes. To address this gap, we propose Knowledge Tracing Leveraging Problem-Solving Process (KT-PSP), which incorporates students' problem-solving processes to capture the multidimensional aspects of mathematical proficiency. We also introduce KT-PSP-25, a new dataset specifically designed for the KT-PSP. Building on this, we present StatusKT, a KT framework that employs a teacher-student-teacher three-stage LLM pipeline to extract students' MP as intermediate signals. In this pipeline, the teacher LLM first extracts problem-specific proficiency indicators, then a student LLM generates responses based on the student's solution process, and a teacher LLM evaluates these responses to determine mastery of each indicator. The experimental results on KT-PSP-25 demonstrate that StatusKT improves the prediction performance of existing KT methods. Moreover, StatusKT provides interpretable explanations for its predictions by explicitly modeling students' mathematical proficiency.
title Tracing Mathematical Proficiency Through Problem-Solving Processes
topic Machine Learning
Artificial Intelligence
Computers and Society
url https://arxiv.org/abs/2512.00311