Calibrating Bayesian Tension Statistics using Neural Ratio Estimation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Bevins, Harry T. J., Handley, William J., Gessey-Jones, Thomas
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914344992768000
author Bevins, Harry T. J.
Handley, William J.
Gessey-Jones, Thomas
author_facet Bevins, Harry T. J.
Handley, William J.
Gessey-Jones, Thomas
contents When fits of the same physical model to two different datasets disagree, we call this tension. Several apparent tensions in cosmology have occupied researchers in recent years, and a number of different metrics have been proposed to quantify tension. Many of these metrics suffer from limiting assumptions, and correctly calibrating these is essential if we want to successfully determine whether discrepancies are significant. A commonly used metric of tension is the evidence ratio R. The statistic has been widely adopted by the community as a Bayesian way of quantifying tensions, however, it has a non-trivial dependence on the prior that is not always accounted for properly. We show that this can be calibrated out effectively with Neural Ratio Estimation. We demonstrate our proposed calibration technique with an analytic example, a toy example inspired by 21-cm cosmology, and with observations of the Baryon Acoustic Oscillations from the Dark Energy Spectroscopic Instrument (DESI) and the Sloan Digital Sky Survey (SDSS). We find no significant tension between DESI and SDSS.
format Preprint
id arxiv_https___arxiv_org_abs_2407_15478
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Calibrating Bayesian Tension Statistics using Neural Ratio Estimation
Bevins, Harry T. J.
Handley, William J.
Gessey-Jones, Thomas
Cosmology and Nongalactic Astrophysics
Instrumentation and Methods for Astrophysics
When fits of the same physical model to two different datasets disagree, we call this tension. Several apparent tensions in cosmology have occupied researchers in recent years, and a number of different metrics have been proposed to quantify tension. Many of these metrics suffer from limiting assumptions, and correctly calibrating these is essential if we want to successfully determine whether discrepancies are significant. A commonly used metric of tension is the evidence ratio R. The statistic has been widely adopted by the community as a Bayesian way of quantifying tensions, however, it has a non-trivial dependence on the prior that is not always accounted for properly. We show that this can be calibrated out effectively with Neural Ratio Estimation. We demonstrate our proposed calibration technique with an analytic example, a toy example inspired by 21-cm cosmology, and with observations of the Baryon Acoustic Oscillations from the Dark Energy Spectroscopic Instrument (DESI) and the Sloan Digital Sky Survey (SDSS). We find no significant tension between DESI and SDSS.
title Calibrating Bayesian Tension Statistics using Neural Ratio Estimation
topic Cosmology and Nongalactic Astrophysics
Instrumentation and Methods for Astrophysics
url https://arxiv.org/abs/2407.15478