Saved in:
Bibliographic Details
Main Authors: Hartman, Erin, Hazlett, Chad, Sadeghpour, Arisa
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2507.19607
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908468211875840
author Hartman, Erin
Hazlett, Chad
Sadeghpour, Arisa
author_facet Hartman, Erin
Hazlett, Chad
Sadeghpour, Arisa
contents Weighting procedures are used in observational causal inference to adjust for covariate imbalance within the sample. Common practice for inference is to estimate robust standard errors from a weighted regression of outcome on treatment. However, it is well known that weighting can inflate variance estimates, sometimes significantly, leading to standard errors and confidence intervals that are overly conservative. We instead examine and recommend the use of robust standard errors from a weighted regression that additionally includes the balancing covariates and their interactions with treatment. We show that these standard errors are more precise and asymptotically correct for weights that achieve exact balance under multiple common resampling frameworks, including design-based and model-based inference, as well as superpopulation sampling with a finite sample correction. Gains to precision can be quite significant when the balancing weights adjust for prognostic covariates. For procedures that balance only approximately or in expectation, such as inverse propensity weighting or approximate balancing weights, our proposed method improves precision by reducing residuals through augmentation with the parametric model. We demonstrate our approach through simulation and re-analysis of multiple empirical studies.
format Preprint
id arxiv_https___arxiv_org_abs_2507_19607
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Inference with weights: Residualization produces short, valid intervals for varying estimands and varying resampling processes
Hartman, Erin
Hazlett, Chad
Sadeghpour, Arisa
Methodology
Weighting procedures are used in observational causal inference to adjust for covariate imbalance within the sample. Common practice for inference is to estimate robust standard errors from a weighted regression of outcome on treatment. However, it is well known that weighting can inflate variance estimates, sometimes significantly, leading to standard errors and confidence intervals that are overly conservative. We instead examine and recommend the use of robust standard errors from a weighted regression that additionally includes the balancing covariates and their interactions with treatment. We show that these standard errors are more precise and asymptotically correct for weights that achieve exact balance under multiple common resampling frameworks, including design-based and model-based inference, as well as superpopulation sampling with a finite sample correction. Gains to precision can be quite significant when the balancing weights adjust for prognostic covariates. For procedures that balance only approximately or in expectation, such as inverse propensity weighting or approximate balancing weights, our proposed method improves precision by reducing residuals through augmentation with the parametric model. We demonstrate our approach through simulation and re-analysis of multiple empirical studies.
title Inference with weights: Residualization produces short, valid intervals for varying estimands and varying resampling processes
topic Methodology
url https://arxiv.org/abs/2507.19607