On Focusing Statistical Power for Searches and Measurements in Particle Physics

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Carzon, James, Ghosh, Aishik, Izbicki, Rafael, Lee, Ann, Masserano, Luca, Whiteson, Daniel
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866918210992865280
author Carzon, James
Ghosh, Aishik
Izbicki, Rafael
Lee, Ann
Masserano, Luca
Whiteson, Daniel
author_facet Carzon, James
Ghosh, Aishik
Izbicki, Rafael
Lee, Ann
Masserano, Luca
Whiteson, Daniel
contents Particle physics experiments rely on the (generalised) likelihood ratio test (LRT) for searches and measurements, which consist of composite hypothesis tests. However, this test is not guaranteed to be optimal, as the Neyman-Pearson lemma pertains only to simple hypothesis tests. Any choice of test statistic thus implicitly determines how statistical power varies across the parameter space. An improvement in the core statistical testing methodology for general settings with composite tests would have widespread ramifications across experiments. We discuss an alternate test statistic that provides the data analyzer an ability to focus the power of the test on physics-motivated regions of the parameter space. We demonstrate the improvement from this technique compared to the LRT on a Higgs $\rightarrowττ$ dataset simulated by the ATLAS experiment and a dark matter dataset inspired by the LZ experiment. We also employ machine learning to efficiently perform the Neyman construction, which is essential to ensure statistically valid confidence intervals.
format Preprint
id arxiv_https___arxiv_org_abs_2507_17831
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle On Focusing Statistical Power for Searches and Measurements in Particle Physics
Carzon, James
Ghosh, Aishik
Izbicki, Rafael
Lee, Ann
Masserano, Luca
Whiteson, Daniel
High Energy Physics - Phenomenology
High Energy Physics - Experiment
Data Analysis, Statistics and Probability
Applications
Methodology
Particle physics experiments rely on the (generalised) likelihood ratio test (LRT) for searches and measurements, which consist of composite hypothesis tests. However, this test is not guaranteed to be optimal, as the Neyman-Pearson lemma pertains only to simple hypothesis tests. Any choice of test statistic thus implicitly determines how statistical power varies across the parameter space. An improvement in the core statistical testing methodology for general settings with composite tests would have widespread ramifications across experiments. We discuss an alternate test statistic that provides the data analyzer an ability to focus the power of the test on physics-motivated regions of the parameter space. We demonstrate the improvement from this technique compared to the LRT on a Higgs $\rightarrowττ$ dataset simulated by the ATLAS experiment and a dark matter dataset inspired by the LZ experiment. We also employ machine learning to efficiently perform the Neyman construction, which is essential to ensure statistically valid confidence intervals.
title On Focusing Statistical Power for Searches and Measurements in Particle Physics
topic High Energy Physics - Phenomenology
High Energy Physics - Experiment
Data Analysis, Statistics and Probability
Applications
Methodology
url https://arxiv.org/abs/2507.17831