Evaluating the impact of instrumental variables in propensity score models using synthetic and negative control experiments

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Tian, Yuxi, Pratt, Nicole, Hester, Laura L, Hripcsak, George, Schuemie, Martijn J, Suchard, Marc A
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914723422797824
author Tian, Yuxi
Pratt, Nicole
Hester, Laura L
Hripcsak, George
Schuemie, Martijn J
Suchard, Marc A
author_facet Tian, Yuxi
Pratt, Nicole
Hester, Laura L
Hripcsak, George
Schuemie, Martijn J
Suchard, Marc A
contents In pharmacoepidemiology research, instrumental variables (IVs) are variables that strongly predict treatment but have no causal effect on the outcome of interest except through the treatment. There remain concerns about the inclusion of IVs in propensity score (PS) models amplifying estimation bias and reducing precision. Some PS modeling approaches attempt to address the potential effects of IVs, including selecting only covariates for the PS model that are strongly associated to the outcome of interest, thus screening out IVs. We conduct a study utilizing simulations and negative control experiments to evaluate the effect of IVs on PS model performance and to uncover best PS practices for real-world studies. We find that simulated IVs have a weak effect on bias and precision in both simulations and negative control experiments based on real-world data. In simulation experiments, PS methods that utilize outcome data, including the high-dimensional propensity score, produce the least estimation bias. However, in real-world settings underlying causal structures are unknown, and negative control experiments can illustrate a PS model's ability to minimize systematic bias. We find that large-scale, regularized regression based PS models in this case provide the most centered negative control distributions, suggesting superior performance in real-world scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2403_14563
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Evaluating the impact of instrumental variables in propensity score models using synthetic and negative control experiments
Tian, Yuxi
Pratt, Nicole
Hester, Laura L
Hripcsak, George
Schuemie, Martijn J
Suchard, Marc A
Methodology
Applications
In pharmacoepidemiology research, instrumental variables (IVs) are variables that strongly predict treatment but have no causal effect on the outcome of interest except through the treatment. There remain concerns about the inclusion of IVs in propensity score (PS) models amplifying estimation bias and reducing precision. Some PS modeling approaches attempt to address the potential effects of IVs, including selecting only covariates for the PS model that are strongly associated to the outcome of interest, thus screening out IVs. We conduct a study utilizing simulations and negative control experiments to evaluate the effect of IVs on PS model performance and to uncover best PS practices for real-world studies. We find that simulated IVs have a weak effect on bias and precision in both simulations and negative control experiments based on real-world data. In simulation experiments, PS methods that utilize outcome data, including the high-dimensional propensity score, produce the least estimation bias. However, in real-world settings underlying causal structures are unknown, and negative control experiments can illustrate a PS model's ability to minimize systematic bias. We find that large-scale, regularized regression based PS models in this case provide the most centered negative control distributions, suggesting superior performance in real-world scenarios.
title Evaluating the impact of instrumental variables in propensity score models using synthetic and negative control experiments
topic Methodology
Applications
url https://arxiv.org/abs/2403.14563