Comparing the efficacy of fixed effect and MAIHDA models in predicting outcomes for intersectional social strata

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Van Dusen, Ben, Cian, Heidi, Nissen, Jayson, Arellano, Lucy, Woods, Adrienne
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909140003061760
author Van Dusen, Ben
Cian, Heidi
Nissen, Jayson
Arellano, Lucy
Woods, Adrienne
author_facet Van Dusen, Ben
Cian, Heidi
Nissen, Jayson
Arellano, Lucy
Woods, Adrienne
contents This investigation examines the efficacy of multilevel analysis of individual heterogeneity and discriminatory accuracy (MAIHDA) over fixed effect models when performing intersectional studies. The research questions are: 1) What are typical strata representation rates and outcomes on physics research-based assessments? 2) To what extent do MAIHDA models create more accurate predicted strata outcomes than fixed effects models? 3) To what extent do MAIHDA models allow the modeling of smaller strata sample sizes? We simulated 3,000 datasets based on real-world data from 5,955 students on the LASSO platform. We found that MAIHDA created more accurate and precise predictions than fixed effect models. We also found that using MAIHDA could allow researchers to disaggregate their data further, creating smaller group sample sizes while maintaining more accurate findings than fixed effect models. We recommend using MAIHDA over fixed effect models for intersectional investigations.
format Preprint
id arxiv_https___arxiv_org_abs_2403_12081
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Comparing the efficacy of fixed effect and MAIHDA models in predicting outcomes for intersectional social strata
Van Dusen, Ben
Cian, Heidi
Nissen, Jayson
Arellano, Lucy
Woods, Adrienne
Physics Education
This investigation examines the efficacy of multilevel analysis of individual heterogeneity and discriminatory accuracy (MAIHDA) over fixed effect models when performing intersectional studies. The research questions are: 1) What are typical strata representation rates and outcomes on physics research-based assessments? 2) To what extent do MAIHDA models create more accurate predicted strata outcomes than fixed effects models? 3) To what extent do MAIHDA models allow the modeling of smaller strata sample sizes? We simulated 3,000 datasets based on real-world data from 5,955 students on the LASSO platform. We found that MAIHDA created more accurate and precise predictions than fixed effect models. We also found that using MAIHDA could allow researchers to disaggregate their data further, creating smaller group sample sizes while maintaining more accurate findings than fixed effect models. We recommend using MAIHDA over fixed effect models for intersectional investigations.
title Comparing the efficacy of fixed effect and MAIHDA models in predicting outcomes for intersectional social strata
topic Physics Education
url https://arxiv.org/abs/2403.12081