Saved in:
Bibliographic Details
Main Authors: Tosh, Christopher, Greengard, Philip, Goodrich, Ben, Gelman, Andrew, Vehtari, Aki, Hsu, Daniel
Format: Preprint
Published: 2021
Subjects:
Online Access:https://arxiv.org/abs/2105.13445
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914883209003008
author Tosh, Christopher
Greengard, Philip
Goodrich, Ben
Gelman, Andrew
Vehtari, Aki
Hsu, Daniel
author_facet Tosh, Christopher
Greengard, Philip
Goodrich, Ben
Gelman, Andrew
Vehtari, Aki
Hsu, Daniel
contents In some scientific fields, it is common to have certain variables of interest that are of particular importance and for which there are many studies indicating a relationship with different explanatory variables. In such cases, particularly those where no relationships are known among the explanatory variables, it is worth asking under what conditions it is possible for all such claimed effects to exist simultaneously. This paper addresses this question by reviewing some theorems from multivariate analysis showing that, unless the explanatory variables also have sizable dependencies with each other, it is impossible to have many such large effects. We discuss implications for the replication crisis in social science.
format Preprint
id arxiv_https___arxiv_org_abs_2105_13445
institution arXiv
publishDate 2021
record_format arxiv
spellingShingle The piranha problem: Large effects swimming in a small pond
Tosh, Christopher
Greengard, Philip
Goodrich, Ben
Gelman, Andrew
Vehtari, Aki
Hsu, Daniel
Statistics Theory
Applications
In some scientific fields, it is common to have certain variables of interest that are of particular importance and for which there are many studies indicating a relationship with different explanatory variables. In such cases, particularly those where no relationships are known among the explanatory variables, it is worth asking under what conditions it is possible for all such claimed effects to exist simultaneously. This paper addresses this question by reviewing some theorems from multivariate analysis showing that, unless the explanatory variables also have sizable dependencies with each other, it is impossible to have many such large effects. We discuss implications for the replication crisis in social science.
title The piranha problem: Large effects swimming in a small pond
topic Statistics Theory
Applications
url https://arxiv.org/abs/2105.13445