Saved in:
Bibliographic Details
Main Author: Dittmann, Alexander J.
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2404.16928
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912040736522240
author Dittmann, Alexander J.
author_facet Dittmann, Alexander J.
contents Nested sampling is a promising tool for Bayesian statistical analysis because it simultaneously performs parameter estimation and facilitates model comparison. MultiNest is one of the most popular nested sampling implementations, and has been applied to a wide variety of problems in the physical sciences. However, MultiNest results, like those of any sampling tool, can be unreliable, and accompanying convergence tests are a necessary component of any analysis. Using analytically tractable test problems, I illustrate how MultiNest, when applied without rigorously chosen hyperparameters, (1) can produce systematically erroneous estimates of the Bayesian evidence, which are more significantly biased for problems of higher dimensionality; (2) can derive posterior estimates with errors on the order of $\sim100\%$; (3) can, particularly when sampling noisy likelihood functions, systematically underestimate posterior widths. Furthermore, I show how MultiNest, thanks to the advantageous speed at which it explores parameter space, can also be used to jump-start Markov chain Monte Carlo sampling or more rigorous nested sampling techniques, potentially accelerating more robust measurements of posterior distributions and Bayesian evidences, and overcoming the challenge of Markov chain Monte Carlo initialization.
format Preprint
id arxiv_https___arxiv_org_abs_2404_16928
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Notes on the Practical Application of Nested Sampling: MultiNest, (Non)convergence, and Rectification
Dittmann, Alexander J.
Instrumentation and Methods for Astrophysics
Computation
Nested sampling is a promising tool for Bayesian statistical analysis because it simultaneously performs parameter estimation and facilitates model comparison. MultiNest is one of the most popular nested sampling implementations, and has been applied to a wide variety of problems in the physical sciences. However, MultiNest results, like those of any sampling tool, can be unreliable, and accompanying convergence tests are a necessary component of any analysis. Using analytically tractable test problems, I illustrate how MultiNest, when applied without rigorously chosen hyperparameters, (1) can produce systematically erroneous estimates of the Bayesian evidence, which are more significantly biased for problems of higher dimensionality; (2) can derive posterior estimates with errors on the order of $\sim100\%$; (3) can, particularly when sampling noisy likelihood functions, systematically underestimate posterior widths. Furthermore, I show how MultiNest, thanks to the advantageous speed at which it explores parameter space, can also be used to jump-start Markov chain Monte Carlo sampling or more rigorous nested sampling techniques, potentially accelerating more robust measurements of posterior distributions and Bayesian evidences, and overcoming the challenge of Markov chain Monte Carlo initialization.
title Notes on the Practical Application of Nested Sampling: MultiNest, (Non)convergence, and Rectification
topic Instrumentation and Methods for Astrophysics
Computation
url https://arxiv.org/abs/2404.16928