The Bottom-Up Approach for Powerful Testing with FWER Control

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Karmakar, Rajesh, Heller, Ruth, Rosset, Saharon
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914161463656448
author Karmakar, Rajesh
Heller, Ruth
Rosset, Saharon
author_facet Karmakar, Rajesh
Heller, Ruth
Rosset, Saharon
contents We seek to design novel multiple testing procedures, which take into account a relevant notion of ''power'' or true discovery on the one hand, and allow computationally efficient test design and application on the other. Towards this end we characterize the optimal procedures that strongly control the family-wise error rate, for a range of power objectives measuring the success of multiple testing procedures in making true individual discoveries, and under a reasonable set of assumptions. While we cannot generally find these optimal solutions in practice, we propose the bottom-up approach, which constructs consonant closed testing procedures, while taking into account the overall power objective in designing the tests on every level of the closed testing hierarchy. This leads to a general recipe, yielding novel procedures which are computationally practical and demonstrate substantially improved power in both simulations and a real data study, compared to existing procedures.
format Preprint
id arxiv_https___arxiv_org_abs_2511_13624
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle The Bottom-Up Approach for Powerful Testing with FWER Control
Karmakar, Rajesh
Heller, Ruth
Rosset, Saharon
Methodology
We seek to design novel multiple testing procedures, which take into account a relevant notion of ''power'' or true discovery on the one hand, and allow computationally efficient test design and application on the other. Towards this end we characterize the optimal procedures that strongly control the family-wise error rate, for a range of power objectives measuring the success of multiple testing procedures in making true individual discoveries, and under a reasonable set of assumptions. While we cannot generally find these optimal solutions in practice, we propose the bottom-up approach, which constructs consonant closed testing procedures, while taking into account the overall power objective in designing the tests on every level of the closed testing hierarchy. This leads to a general recipe, yielding novel procedures which are computationally practical and demonstrate substantially improved power in both simulations and a real data study, compared to existing procedures.
title The Bottom-Up Approach for Powerful Testing with FWER Control
topic Methodology
url https://arxiv.org/abs/2511.13624