Polytomous Explanatory Item Response Models for Item Discrimination: Assessing Negative-Framing Effects in Social-Emotional Learning Surveys

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Gilbert, Joshua B., Zhang, Lijin, Ulitzsch, Esther, Domingue, Benjamin W.
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866918066983534592
author Gilbert, Joshua B.
Zhang, Lijin
Ulitzsch, Esther
Domingue, Benjamin W.
author_facet Gilbert, Joshua B.
Zhang, Lijin
Ulitzsch, Esther
Domingue, Benjamin W.
contents Modeling item parameters as a function of item characteristics has a long history but has generally focused on models for item location. Explanatory item response models for item discrimination are available but rarely used. In this study, we extend existing approaches for modeling item discrimination from dichotomous to polytomous item responses. We illustrate our proposed approach with an application to four social-emotional learning surveys of preschool children to investigate how item discrimination depends on whether an item is positively or negatively framed. Negative framing predicts significantly lower item discrimination on two of the four surveys, and a plausibly causal estimate from a regression discontinuity analysis shows that negative framing reduces discrimination by about 30\% on one survey. We conclude with a discussion of potential applications of explanatory models for item discrimination.
format Preprint
id arxiv_https___arxiv_org_abs_2406_05304
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Polytomous Explanatory Item Response Models for Item Discrimination: Assessing Negative-Framing Effects in Social-Emotional Learning Surveys
Gilbert, Joshua B.
Zhang, Lijin
Ulitzsch, Esther
Domingue, Benjamin W.
Methodology
Modeling item parameters as a function of item characteristics has a long history but has generally focused on models for item location. Explanatory item response models for item discrimination are available but rarely used. In this study, we extend existing approaches for modeling item discrimination from dichotomous to polytomous item responses. We illustrate our proposed approach with an application to four social-emotional learning surveys of preschool children to investigate how item discrimination depends on whether an item is positively or negatively framed. Negative framing predicts significantly lower item discrimination on two of the four surveys, and a plausibly causal estimate from a regression discontinuity analysis shows that negative framing reduces discrimination by about 30\% on one survey. We conclude with a discussion of potential applications of explanatory models for item discrimination.
title Polytomous Explanatory Item Response Models for Item Discrimination: Assessing Negative-Framing Effects in Social-Emotional Learning Surveys
topic Methodology
url https://arxiv.org/abs/2406.05304