Assumption Smuggling in Intermediate Outcome Tests of Causal Mechanisms
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866910705490329600 |
|---|---|
| author | Blackwell, Matthew Ma, Ruofan Opacic, Aleksei |
| author_facet | Blackwell, Matthew Ma, Ruofan Opacic, Aleksei |
| contents | Political scientists are increasingly interested in assessing causal mechanisms, or determining not just if a causal effect exists but also why it occurs. Even so, many researchers avoid formal causal mediation analyses due to their stringent assumptions, instead opting to explore causal mechanisms through what we call intermediate outcome tests. These tests estimate the effect of the treatment on one or more mediators and view such effects as suggestive evidence of a causal mechanism. In this paper, we use nonparametric bounding analysis to show that, without further assumptions, these tests can neither establish nor rule out the existence of a causal mechanism. To use intermediate outcome tests as a falsification test of causal mechanisms, researchers must make a very strong but rarely discussed monotonicity assumption. We develop a way to assess the plausibility of this monotonicity assumption and estimate our bounds for two recent experiments that use these tests. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_07072 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Assumption Smuggling in Intermediate Outcome Tests of Causal Mechanisms Blackwell, Matthew Ma, Ruofan Opacic, Aleksei Applications Methodology Political scientists are increasingly interested in assessing causal mechanisms, or determining not just if a causal effect exists but also why it occurs. Even so, many researchers avoid formal causal mediation analyses due to their stringent assumptions, instead opting to explore causal mechanisms through what we call intermediate outcome tests. These tests estimate the effect of the treatment on one or more mediators and view such effects as suggestive evidence of a causal mechanism. In this paper, we use nonparametric bounding analysis to show that, without further assumptions, these tests can neither establish nor rule out the existence of a causal mechanism. To use intermediate outcome tests as a falsification test of causal mechanisms, researchers must make a very strong but rarely discussed monotonicity assumption. We develop a way to assess the plausibility of this monotonicity assumption and estimate our bounds for two recent experiments that use these tests. |
| title | Assumption Smuggling in Intermediate Outcome Tests of Causal Mechanisms |
| topic | Applications Methodology |
| url | https://arxiv.org/abs/2407.07072 |