Saved in:
Bibliographic Details
Main Authors: Spertus, Jacob V., Sridhar, Mayuri, Stark, Philip B.
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2409.06680
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917339314782208
author Spertus, Jacob V.
Sridhar, Mayuri
Stark, Philip B.
author_facet Spertus, Jacob V.
Sridhar, Mayuri
Stark, Philip B.
contents We develop conservative tests for the mean of a bounded population under stratified sampling and apply them to risk-limiting post-election audits. The tests are ``anytime valid'' under sequential sampling, allowing optional stopping in each stratum. Our core method expresses a global hypothesis about the population mean as a union of intersection hypotheses describing within-stratum means. It tests each intersection hypothesis using independent test supermartingales (TSMs) combined across strata by multiplication. A $P$-value for each intersection hypothesis is the reciprocal of that test statistic, and the largest $P$-value in the union is a $P$-value for the global hypothesis. This approach has two primary moving parts: the rule selecting which stratum to draw from next given the sample so far, and the form of the TSM within each stratum. These rules may vary over intersection hypotheses. We construct the test with the smallest expected stopping time and present a few strategies for approximating that optimum. In instances that arise in auditing and other applications, its expected sample size is substantially smaller than that of previous methods.
format Preprint
id arxiv_https___arxiv_org_abs_2409_06680
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Sequential stratified inference for the mean
Spertus, Jacob V.
Sridhar, Mayuri
Stark, Philip B.
Methodology
We develop conservative tests for the mean of a bounded population under stratified sampling and apply them to risk-limiting post-election audits. The tests are ``anytime valid'' under sequential sampling, allowing optional stopping in each stratum. Our core method expresses a global hypothesis about the population mean as a union of intersection hypotheses describing within-stratum means. It tests each intersection hypothesis using independent test supermartingales (TSMs) combined across strata by multiplication. A $P$-value for each intersection hypothesis is the reciprocal of that test statistic, and the largest $P$-value in the union is a $P$-value for the global hypothesis. This approach has two primary moving parts: the rule selecting which stratum to draw from next given the sample so far, and the form of the TSM within each stratum. These rules may vary over intersection hypotheses. We construct the test with the smallest expected stopping time and present a few strategies for approximating that optimum. In instances that arise in auditing and other applications, its expected sample size is substantially smaller than that of previous methods.
title Sequential stratified inference for the mean
topic Methodology
url https://arxiv.org/abs/2409.06680