Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wasserman, Joshua, Elliott, Michael R., Hansen, Ben B.
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:https://arxiv.org/abs/2512.08144
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908699795128320
author Wasserman, Joshua
Elliott, Michael R.
Hansen, Ben B.
author_facet Wasserman, Joshua
Elliott, Michael R.
Hansen, Ben B.
contents U.S. state education agencies mark schools displaying achievement gaps between demographic subgroups as needing improvement. Some schools may have few students in these subgroups, such that average end-of-year test scores only noisily measure the average "true" score--the score one would expect if students took the test many times. This, in addition to the masking of small subgroup averages in publicly available assessment data, poses challenges for evaluating interventions aimed at closing achievement gaps. We introduce propensity score estimates designed to achieve balance on subgroup average true scores. These estimates are available even when noisy measurements are not and improve overlap compared to those that ignore measurement error, leading to greater bias reduction of matching estimators. We demonstrate our methods through simulation and an application to a statewide initiative in Texas for curbing summer learning loss.
format Preprint
id arxiv_https___arxiv_org_abs_2512_08144
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Propensity score adjustment when errors in achievement measures inform treatment assignment
Wasserman, Joshua
Elliott, Michael R.
Hansen, Ben B.
Methodology
U.S. state education agencies mark schools displaying achievement gaps between demographic subgroups as needing improvement. Some schools may have few students in these subgroups, such that average end-of-year test scores only noisily measure the average "true" score--the score one would expect if students took the test many times. This, in addition to the masking of small subgroup averages in publicly available assessment data, poses challenges for evaluating interventions aimed at closing achievement gaps. We introduce propensity score estimates designed to achieve balance on subgroup average true scores. These estimates are available even when noisy measurements are not and improve overlap compared to those that ignore measurement error, leading to greater bias reduction of matching estimators. We demonstrate our methods through simulation and an application to a statewide initiative in Texas for curbing summer learning loss.
title Propensity score adjustment when errors in achievement measures inform treatment assignment
topic Methodology
url https://arxiv.org/abs/2512.08144