Saved in:
Bibliographic Details
Main Authors: Sui, Daihe, Tipton, Elizabeth
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2604.27887
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913077037891584
author Sui, Daihe
Tipton, Elizabeth
author_facet Sui, Daihe
Tipton, Elizabeth
contents Standard random-effects meta-analysis relies heavily on the assumption that the underlying true effects are normally distributed. In the social sciences, where evidence synthesis increasingly involves large, highly heterogeneous datasets, this assumption is often restrictive and unjustified. Misspecification of the random-effects distribution prevents the detection of asymmetry or multimodality, potentially leading to erroneous conclusions regarding the prevalence of adverse effects or the existence of specific subgroups. This paper introduces a Penalized Gaussian Mixture (PGM) framework designed to recover the entire probability density function of true effects without enforcing a rigid parametric shape. The method adapts to different non-normal scenarios, including skewed and multimodal distributions, while reducing to the normal case when supported by the data. A simulation study demonstrates that in large, highly heterogeneous meta-analyses, PGM yields substantially more accurate estimates of tail probabilities and the density function than standard methods when normality is violated, without substantially compromising efficiency under normality. An empirical application to environmental education data illustrates the practical utility of the method. The proposed framework provides researchers with a robust tool to move beyond simple summary statistics and characterize the complex nature of the true effect distribution in the real world.
format Preprint
id arxiv_https___arxiv_org_abs_2604_27887
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Meta-Analysis Without Normality: Estimating the True Effect Distribution with Penalized Gaussian Mixtures
Sui, Daihe
Tipton, Elizabeth
Methodology
Standard random-effects meta-analysis relies heavily on the assumption that the underlying true effects are normally distributed. In the social sciences, where evidence synthesis increasingly involves large, highly heterogeneous datasets, this assumption is often restrictive and unjustified. Misspecification of the random-effects distribution prevents the detection of asymmetry or multimodality, potentially leading to erroneous conclusions regarding the prevalence of adverse effects or the existence of specific subgroups. This paper introduces a Penalized Gaussian Mixture (PGM) framework designed to recover the entire probability density function of true effects without enforcing a rigid parametric shape. The method adapts to different non-normal scenarios, including skewed and multimodal distributions, while reducing to the normal case when supported by the data. A simulation study demonstrates that in large, highly heterogeneous meta-analyses, PGM yields substantially more accurate estimates of tail probabilities and the density function than standard methods when normality is violated, without substantially compromising efficiency under normality. An empirical application to environmental education data illustrates the practical utility of the method. The proposed framework provides researchers with a robust tool to move beyond simple summary statistics and characterize the complex nature of the true effect distribution in the real world.
title Meta-Analysis Without Normality: Estimating the True Effect Distribution with Penalized Gaussian Mixtures
topic Methodology
url https://arxiv.org/abs/2604.27887