Saved in:
Bibliographic Details
Main Author: Press, William H.
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2512.01003
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911296039944192
author Press, William H.
author_facet Press, William H.
contents Results in epidemiology and social science often require the removal of confounding effects from measurements of the pairwise correlation of variables in survey data. This is typically accomplished by some variant of linear regression (e.g., ``logistic" or ``Cox proportional"). But, knowing whether all possible confounders have been identified, or are even visible (not latent), is in general impossible. Here, we exhibit two examples that frame the issue. The first example proposes a highly unlikely hypothesis on drug use, draws data from a large, respected survey, and succeeds in ``proving" the implausible hypothesis, despite regressing out more than 20 confounding variables. The second constructs a ``metamodel" in which a single (by hypothesis unmeasurable) latent variable affects many mutually correlated confounders. From simulations, we derive formulas for the magnitude of spurious association that persists even as increasing numbers of confounders are regressed out. The intent of these examples is for them to serve as cautionary tales.
format Preprint
id arxiv_https___arxiv_org_abs_2512_01003
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Correlated Confounding Variables Are Not Easily Controlled for in Large Survey Research
Press, William H.
Methodology
Applications
Results in epidemiology and social science often require the removal of confounding effects from measurements of the pairwise correlation of variables in survey data. This is typically accomplished by some variant of linear regression (e.g., ``logistic" or ``Cox proportional"). But, knowing whether all possible confounders have been identified, or are even visible (not latent), is in general impossible. Here, we exhibit two examples that frame the issue. The first example proposes a highly unlikely hypothesis on drug use, draws data from a large, respected survey, and succeeds in ``proving" the implausible hypothesis, despite regressing out more than 20 confounding variables. The second constructs a ``metamodel" in which a single (by hypothesis unmeasurable) latent variable affects many mutually correlated confounders. From simulations, we derive formulas for the magnitude of spurious association that persists even as increasing numbers of confounders are regressed out. The intent of these examples is for them to serve as cautionary tales.
title Correlated Confounding Variables Are Not Easily Controlled for in Large Survey Research
topic Methodology
Applications
url https://arxiv.org/abs/2512.01003