Saved in:
Bibliographic Details
Main Authors: Djordjilović, Vera, Sofer, Tamar, Dreyfuss, Jonathan M.
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2510.11273
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908806910312448
author Djordjilović, Vera
Sofer, Tamar
Dreyfuss, Jonathan M.
author_facet Djordjilović, Vera
Sofer, Tamar
Dreyfuss, Jonathan M.
contents Directional replicability addresses the question of whether an effect studied across $n$ independent studies is present with the same direction in at least $r$ of them, for $r \geq 2$. When the expected direction of the effect is not specified in advance, the state of the art recommends assessing replicability separately by combining one-sided $p$-values for both directions (left and right), and then doubling the smaller of the two resulting combined $p$-values to account for multiple testing. In this work, we show that this multiplicative correction is not always necessary, and give conditions under which it can be safely omitted.
format Preprint
id arxiv_https___arxiv_org_abs_2510_11273
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Directional replicability: when can the factor of two be omitted
Djordjilović, Vera
Sofer, Tamar
Dreyfuss, Jonathan M.
Methodology
Directional replicability addresses the question of whether an effect studied across $n$ independent studies is present with the same direction in at least $r$ of them, for $r \geq 2$. When the expected direction of the effect is not specified in advance, the state of the art recommends assessing replicability separately by combining one-sided $p$-values for both directions (left and right), and then doubling the smaller of the two resulting combined $p$-values to account for multiple testing. In this work, we show that this multiplicative correction is not always necessary, and give conditions under which it can be safely omitted.
title Directional replicability: when can the factor of two be omitted
topic Methodology
url https://arxiv.org/abs/2510.11273