AAKT: Enhancing Knowledge Tracing with Alternate Autoregressive Modeling

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhou, Hao, Rong, Wenge, Zhang, Jianfei, Sun, Qing, Ouyang, Yuanxin, Xiong, Zhang
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909497399705600
author Zhou, Hao
Rong, Wenge
Zhang, Jianfei
Sun, Qing
Ouyang, Yuanxin
Xiong, Zhang
author_facet Zhou, Hao
Rong, Wenge
Zhang, Jianfei
Sun, Qing
Ouyang, Yuanxin
Xiong, Zhang
contents Knowledge Tracing (KT) aims to predict students' future performances based on their former exercises and additional information in educational settings. KT has received significant attention since it facilitates personalized experiences in educational situations. Simultaneously, the autoregressive modeling on the sequence of former exercises has been proven effective for this task. One of the primary challenges in autoregressive modeling for Knowledge Tracing is effectively representing the anterior (pre-response) and posterior (post-response) states of learners across exercises. Existing methods often employ complex model architectures to update learner states using question and response records. In this study, we propose a novel perspective on knowledge tracing task by treating it as a generative process, consistent with the principles of autoregressive models. We demonstrate that knowledge states can be directly represented through autoregressive encodings on a question-response alternate sequence, where model generate the most probable representation in hidden state space by analyzing history interactions. This approach underpins our framework, termed Alternate Autoregressive Knowledge Tracing (AAKT). Additionally, we incorporate supplementary educational information, such as question-related skills, into our framework through an auxiliary task, and include extra exercise details, like response time, as additional inputs. Our proposed framework is implemented using advanced autoregressive technologies from Natural Language Generation (NLG) for both training and prediction. Empirical evaluations on four real-world KT datasets indicate that AAKT consistently outperforms all baseline models in terms of AUC, ACC, and RMSE. Furthermore, extensive ablation studies and visualized analysis validate the effectiveness of key components in AAKT.
format Preprint
id arxiv_https___arxiv_org_abs_2502_11817
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle AAKT: Enhancing Knowledge Tracing with Alternate Autoregressive Modeling
Zhou, Hao
Rong, Wenge
Zhang, Jianfei
Sun, Qing
Ouyang, Yuanxin
Xiong, Zhang
Artificial Intelligence
Computers and Society
Machine Learning
Knowledge Tracing (KT) aims to predict students' future performances based on their former exercises and additional information in educational settings. KT has received significant attention since it facilitates personalized experiences in educational situations. Simultaneously, the autoregressive modeling on the sequence of former exercises has been proven effective for this task. One of the primary challenges in autoregressive modeling for Knowledge Tracing is effectively representing the anterior (pre-response) and posterior (post-response) states of learners across exercises. Existing methods often employ complex model architectures to update learner states using question and response records. In this study, we propose a novel perspective on knowledge tracing task by treating it as a generative process, consistent with the principles of autoregressive models. We demonstrate that knowledge states can be directly represented through autoregressive encodings on a question-response alternate sequence, where model generate the most probable representation in hidden state space by analyzing history interactions. This approach underpins our framework, termed Alternate Autoregressive Knowledge Tracing (AAKT). Additionally, we incorporate supplementary educational information, such as question-related skills, into our framework through an auxiliary task, and include extra exercise details, like response time, as additional inputs. Our proposed framework is implemented using advanced autoregressive technologies from Natural Language Generation (NLG) for both training and prediction. Empirical evaluations on four real-world KT datasets indicate that AAKT consistently outperforms all baseline models in terms of AUC, ACC, and RMSE. Furthermore, extensive ablation studies and visualized analysis validate the effectiveness of key components in AAKT.
title AAKT: Enhancing Knowledge Tracing with Alternate Autoregressive Modeling
topic Artificial Intelligence
Computers and Society
Machine Learning
url https://arxiv.org/abs/2502.11817