Improving Wald's (approximate) sequential probability ratio test by avoiding overshoot
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908438676635648 |
|---|---|
| author | Fischer, Lasse Ramdas, Aaditya |
| author_facet | Fischer, Lasse Ramdas, Aaditya |
| contents | Wald's sequential probability ratio test (SPRT) is a cornerstone of sequential analysis. Based on desired type-I, II error levels $α, β$, it stops when the likelihood ratio crosses certain thresholds, guaranteeing optimality of the expected sample size. However, these thresholds are not closed form and the test is often applied with approximate thresholds $(1-β)/α$ and $β/(1-α)$ (approximate SPRT). When $β> 0$, this neither guarantees error control at $α,β$ nor optimality. When $β=0$ (power-one SPRT), this method is conservative and not optimal. The looseness in both cases is caused by \emph{overshoot}: the test statistic overshoots the thresholds at the stopping time. Numerically calculating thresholds may be infeasible, and most software packages do not do this. We improve the approximate SPRT by modifying the test statistic to avoid overshoot. Our `sequential boosting' technique uniformly improves power-one SPRTs $(β=0)$ for simple nulls and alternatives, or for one-sided nulls and alternatives in exponential families. When $β> 0$, our techniques provide guaranteed error control at $α,β$, while needing less samples than the approximate SPRT in our simulations. We also provide several nontrivial extensions: confidence sequences, sampling without replacement and conformal martingales. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_16076 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Improving Wald's (approximate) sequential probability ratio test by avoiding overshoot Fischer, Lasse Ramdas, Aaditya Methodology Wald's sequential probability ratio test (SPRT) is a cornerstone of sequential analysis. Based on desired type-I, II error levels $α, β$, it stops when the likelihood ratio crosses certain thresholds, guaranteeing optimality of the expected sample size. However, these thresholds are not closed form and the test is often applied with approximate thresholds $(1-β)/α$ and $β/(1-α)$ (approximate SPRT). When $β> 0$, this neither guarantees error control at $α,β$ nor optimality. When $β=0$ (power-one SPRT), this method is conservative and not optimal. The looseness in both cases is caused by \emph{overshoot}: the test statistic overshoots the thresholds at the stopping time. Numerically calculating thresholds may be infeasible, and most software packages do not do this. We improve the approximate SPRT by modifying the test statistic to avoid overshoot. Our `sequential boosting' technique uniformly improves power-one SPRTs $(β=0)$ for simple nulls and alternatives, or for one-sided nulls and alternatives in exponential families. When $β> 0$, our techniques provide guaranteed error control at $α,β$, while needing less samples than the approximate SPRT in our simulations. We also provide several nontrivial extensions: confidence sequences, sampling without replacement and conformal martingales. |
| title | Improving Wald's (approximate) sequential probability ratio test by avoiding overshoot |
| topic | Methodology |
| url | https://arxiv.org/abs/2410.16076 |