Saved in:
Bibliographic Details
Main Authors: Shchepakin, Denis, Sankaranarayanan, Sreecharan, Zimmaro, Dawn
Format: Preprint
Published: 2023
Subjects:
Online Access:https://arxiv.org/abs/2401.09456
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917569859944448
author Shchepakin, Denis
Sankaranarayanan, Sreecharan
Zimmaro, Dawn
author_facet Shchepakin, Denis
Sankaranarayanan, Sreecharan
Zimmaro, Dawn
contents Bayesian Knowledge Tracing (BKT) is a probabilistic model of a learner's state of mastery corresponding to a knowledge component. It considers the learner's state of mastery as a "hidden" or latent binary variable and updates this state based on the observed correctness of the learner's response using parameters that represent transition probabilities between states. BKT is often represented as a Hidden Markov Model and the Expectation-Maximization (EM) algorithm is used to infer these parameters. However, this algorithm can suffer from several issues including producing multiple viable sets of parameters, settling into a local minima, producing degenerate parameter values, and a high computational cost during fitting. This paper takes a "from first principles" approach to deriving constraints that can be imposed on the BKT parameter space. Starting from the basic mathematical truths of probability and building up to the behaviors expected of the BKT parameters in real systems, this paper presents a mathematical derivation that results in succinct constraints that can be imposed on the BKT parameter space. Since these constraints are necessary conditions, they can be applied prior to fitting in order to reduce computational cost and the likelihood of issues that can emerge from the EM procedure. In order to see that promise through, the paper further introduces a novel algorithm for estimating BKT parameters subject to the newly defined constraints. While the issue of degenerate parameter values has been reported previously, this paper is the first, to our best knowledge, to derive the constrains from first principles while also presenting an algorithm that respects those constraints.
format Preprint
id arxiv_https___arxiv_org_abs_2401_09456
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Parametric Constraints for Bayesian Knowledge Tracing from First Principles
Shchepakin, Denis
Sankaranarayanan, Sreecharan
Zimmaro, Dawn
Computers and Society
Machine Learning
62F15 (Primary) 62M05, 60J20, 68T30, 91E40 (Secondary)
Bayesian Knowledge Tracing (BKT) is a probabilistic model of a learner's state of mastery corresponding to a knowledge component. It considers the learner's state of mastery as a "hidden" or latent binary variable and updates this state based on the observed correctness of the learner's response using parameters that represent transition probabilities between states. BKT is often represented as a Hidden Markov Model and the Expectation-Maximization (EM) algorithm is used to infer these parameters. However, this algorithm can suffer from several issues including producing multiple viable sets of parameters, settling into a local minima, producing degenerate parameter values, and a high computational cost during fitting. This paper takes a "from first principles" approach to deriving constraints that can be imposed on the BKT parameter space. Starting from the basic mathematical truths of probability and building up to the behaviors expected of the BKT parameters in real systems, this paper presents a mathematical derivation that results in succinct constraints that can be imposed on the BKT parameter space. Since these constraints are necessary conditions, they can be applied prior to fitting in order to reduce computational cost and the likelihood of issues that can emerge from the EM procedure. In order to see that promise through, the paper further introduces a novel algorithm for estimating BKT parameters subject to the newly defined constraints. While the issue of degenerate parameter values has been reported previously, this paper is the first, to our best knowledge, to derive the constrains from first principles while also presenting an algorithm that respects those constraints.
title Parametric Constraints for Bayesian Knowledge Tracing from First Principles
topic Computers and Society
Machine Learning
62F15 (Primary) 62M05, 60J20, 68T30, 91E40 (Secondary)
url https://arxiv.org/abs/2401.09456