Learning Likelihood Ratios with Neural Network Classifiers

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Rizvi, Shahzar, Pettee, Mariel, Nachman, Benjamin
Format: Preprint
Veröffentlicht: 2023
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916514776481792
author Rizvi, Shahzar
Pettee, Mariel
Nachman, Benjamin
author_facet Rizvi, Shahzar
Pettee, Mariel
Nachman, Benjamin
contents The likelihood ratio is a crucial quantity for statistical inference in science that enables hypothesis testing, construction of confidence intervals, reweighting of distributions, and more. Many modern scientific applications, however, make use of data- or simulation-driven models for which computing the likelihood ratio can be very difficult or even impossible. By applying the so-called ``likelihood ratio trick,'' approximations of the likelihood ratio may be computed using clever parametrizations of neural network-based classifiers. A number of different neural network setups can be defined to satisfy this procedure, each with varying performance in approximating the likelihood ratio when using finite training data. We present a series of empirical studies detailing the performance of several common loss functionals and parametrizations of the classifier output in approximating the likelihood ratio of two univariate and multivariate Gaussian distributions as well as simulated high-energy particle physics datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2305_10500
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Learning Likelihood Ratios with Neural Network Classifiers
Rizvi, Shahzar
Pettee, Mariel
Nachman, Benjamin
High Energy Physics - Phenomenology
Data Analysis, Statistics and Probability
Applications
Machine Learning
The likelihood ratio is a crucial quantity for statistical inference in science that enables hypothesis testing, construction of confidence intervals, reweighting of distributions, and more. Many modern scientific applications, however, make use of data- or simulation-driven models for which computing the likelihood ratio can be very difficult or even impossible. By applying the so-called ``likelihood ratio trick,'' approximations of the likelihood ratio may be computed using clever parametrizations of neural network-based classifiers. A number of different neural network setups can be defined to satisfy this procedure, each with varying performance in approximating the likelihood ratio when using finite training data. We present a series of empirical studies detailing the performance of several common loss functionals and parametrizations of the classifier output in approximating the likelihood ratio of two univariate and multivariate Gaussian distributions as well as simulated high-energy particle physics datasets.
title Learning Likelihood Ratios with Neural Network Classifiers
topic High Energy Physics - Phenomenology
Data Analysis, Statistics and Probability
Applications
Machine Learning
url https://arxiv.org/abs/2305.10500