Edgington's Method for Random-Effects Meta-Analysis Part II: Prediction

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kronthaler, David, Held, Leonhard
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912648507949056
author Kronthaler, David
Held, Leonhard
author_facet Kronthaler, David
Held, Leonhard
contents Statistical inference about the average effect in random-effects meta-analysis has been considered insufficient in the presence of substantial between-study heterogeneity. Predictive distributions are well-suited for quantifying heterogeneity since they are interpretable on the effect scale and provide clinically relevant information about future events. We construct predictive distributions accounting for uncertainty through confidence distributions from Edgington's $p$-value combination method and the generalized heterogeneity statistic. Simulation results suggest that 95% prediction intervals typically achieve nominal coverage when more than three studies are available and effectively reflect skewness in effect estimates in scenarios with 20 or less studies. Formulations that ignore uncertainty in heterogeneity estimation typically fail to achieve correct coverage, underscoring the need for this adjustment in random-effects meta-analysis.
format Preprint
id arxiv_https___arxiv_org_abs_2510_13216
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Edgington's Method for Random-Effects Meta-Analysis Part II: Prediction
Kronthaler, David
Held, Leonhard
Methodology
Statistical inference about the average effect in random-effects meta-analysis has been considered insufficient in the presence of substantial between-study heterogeneity. Predictive distributions are well-suited for quantifying heterogeneity since they are interpretable on the effect scale and provide clinically relevant information about future events. We construct predictive distributions accounting for uncertainty through confidence distributions from Edgington's $p$-value combination method and the generalized heterogeneity statistic. Simulation results suggest that 95% prediction intervals typically achieve nominal coverage when more than three studies are available and effectively reflect skewness in effect estimates in scenarios with 20 or less studies. Formulations that ignore uncertainty in heterogeneity estimation typically fail to achieve correct coverage, underscoring the need for this adjustment in random-effects meta-analysis.
title Edgington's Method for Random-Effects Meta-Analysis Part II: Prediction
topic Methodology
url https://arxiv.org/abs/2510.13216