Misspecifying non-compensatory as compensatory IRT: analysis of estimated skills and variance

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Tamano, Hiroshi, Hino, Hideitsu, Mochihashi, Daichi
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908457728212992
author Tamano, Hiroshi
Hino, Hideitsu
Mochihashi, Daichi
author_facet Tamano, Hiroshi
Hino, Hideitsu
Mochihashi, Daichi
contents Multidimensional item response theory is a statistical test theory used to estimate the latent skills of learners and the difficulty levels of problems based on test results. Both compensatory and non-compensatory models have been proposed in the literature. Previous studies have revealed the substantial underestimation of higher skills when the non-compensatory model is misspecified as the compensatory model. However, the underlying mechanism behind this phenomenon has not been fully elucidated. It remains unclear whether overestimation also occurs and whether issues arise regarding the variance of the estimated parameters. In this paper, we aim to provide a comprehensive understanding of both underestimation and overestimation through a theoretical approach. In addition to the previously identified underestimation of the skills, we newly discover that the overestimation of skills occurs around the origin. Furthermore, we investigate the extent to which the asymptotic variance of the estimated parameters differs when considering model misspecification compared to when it is not taken into account.
format Preprint
id arxiv_https___arxiv_org_abs_2507_15222
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Misspecifying non-compensatory as compensatory IRT: analysis of estimated skills and variance
Tamano, Hiroshi
Hino, Hideitsu
Mochihashi, Daichi
Methodology
Machine Learning
Multidimensional item response theory is a statistical test theory used to estimate the latent skills of learners and the difficulty levels of problems based on test results. Both compensatory and non-compensatory models have been proposed in the literature. Previous studies have revealed the substantial underestimation of higher skills when the non-compensatory model is misspecified as the compensatory model. However, the underlying mechanism behind this phenomenon has not been fully elucidated. It remains unclear whether overestimation also occurs and whether issues arise regarding the variance of the estimated parameters. In this paper, we aim to provide a comprehensive understanding of both underestimation and overestimation through a theoretical approach. In addition to the previously identified underestimation of the skills, we newly discover that the overestimation of skills occurs around the origin. Furthermore, we investigate the extent to which the asymptotic variance of the estimated parameters differs when considering model misspecification compared to when it is not taken into account.
title Misspecifying non-compensatory as compensatory IRT: analysis of estimated skills and variance
topic Methodology
Machine Learning
url https://arxiv.org/abs/2507.15222