Uncovering Bias Mechanisms in Observational Studies

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Demirel, Ilker, Hussain, Zeshan, De Bartolomeis, Piersilvio, Sontag, David
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913870252081152
author Demirel, Ilker
Hussain, Zeshan
De Bartolomeis, Piersilvio
Sontag, David
author_facet Demirel, Ilker
Hussain, Zeshan
De Bartolomeis, Piersilvio
Sontag, David
contents Observational studies are a key resource for causal inference but are often affected by systematic biases. Prior work has focused mainly on detecting these biases, via sensitivity analyses and comparisons with randomized controlled trials, or mitigating them through debiasing techniques. However, there remains a lack of methodology for uncovering the underlying mechanisms driving these biases, e.g., whether due to hidden confounding or selection of participants. In this work, we show that the relationship between bias magnitude and the predictive performance of nuisance function estimators (in the observational study) can help distinguish among common sources of causal bias. We validate our methodology through extensive synthetic experiments and a real-world case study, demonstrating its effectiveness in revealing the mechanisms behind observed biases. Our framework offers a new lens for understanding and characterizing bias in observational studies, with practical implications for improving causal inference.
format Preprint
id arxiv_https___arxiv_org_abs_2506_01191
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Uncovering Bias Mechanisms in Observational Studies
Demirel, Ilker
Hussain, Zeshan
De Bartolomeis, Piersilvio
Sontag, David
Methodology
Machine Learning
Observational studies are a key resource for causal inference but are often affected by systematic biases. Prior work has focused mainly on detecting these biases, via sensitivity analyses and comparisons with randomized controlled trials, or mitigating them through debiasing techniques. However, there remains a lack of methodology for uncovering the underlying mechanisms driving these biases, e.g., whether due to hidden confounding or selection of participants. In this work, we show that the relationship between bias magnitude and the predictive performance of nuisance function estimators (in the observational study) can help distinguish among common sources of causal bias. We validate our methodology through extensive synthetic experiments and a real-world case study, demonstrating its effectiveness in revealing the mechanisms behind observed biases. Our framework offers a new lens for understanding and characterizing bias in observational studies, with practical implications for improving causal inference.
title Uncovering Bias Mechanisms in Observational Studies
topic Methodology
Machine Learning
url https://arxiv.org/abs/2506.01191