Saved in:
Bibliographic Details
Main Authors: Cai, Xiaohao, McEwen, Jason D., Pereyra, Marcelo
Format: Preprint
Published: 2021
Subjects:
Online Access:https://arxiv.org/abs/2106.03646
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914640441638912
author Cai, Xiaohao
McEwen, Jason D.
Pereyra, Marcelo
author_facet Cai, Xiaohao
McEwen, Jason D.
Pereyra, Marcelo
contents Bayesian model selection provides a powerful framework for objectively comparing models directly from observed data, without reference to ground truth data. However, Bayesian model selection requires the computation of the marginal likelihood (model evidence), which is computationally challenging, prohibiting its use in many high-dimensional Bayesian inverse problems. With Bayesian imaging applications in mind, in this work we present the proximal nested sampling methodology to objectively compare alternative Bayesian imaging models for applications that use images to inform decisions under uncertainty. The methodology is based on nested sampling, a Monte Carlo approach specialised for model comparison, and exploits proximal Markov chain Monte Carlo techniques to scale efficiently to large problems and to tackle models that are log-concave and not necessarily smooth (e.g., involving l_1 or total-variation priors). The proposed approach can be applied computationally to problems of dimension O(10^6) and beyond, making it suitable for high-dimensional inverse imaging problems. It is validated on large Gaussian models, for which the likelihood is available analytically, and subsequently illustrated on a range of imaging problems where it is used to analyse different choices of dictionary and measurement model.
format Preprint
id arxiv_https___arxiv_org_abs_2106_03646
institution arXiv
publishDate 2021
record_format arxiv
spellingShingle Proximal nested sampling for high-dimensional Bayesian model selection
Cai, Xiaohao
McEwen, Jason D.
Pereyra, Marcelo
Methodology
Instrumentation and Methods for Astrophysics
Bayesian model selection provides a powerful framework for objectively comparing models directly from observed data, without reference to ground truth data. However, Bayesian model selection requires the computation of the marginal likelihood (model evidence), which is computationally challenging, prohibiting its use in many high-dimensional Bayesian inverse problems. With Bayesian imaging applications in mind, in this work we present the proximal nested sampling methodology to objectively compare alternative Bayesian imaging models for applications that use images to inform decisions under uncertainty. The methodology is based on nested sampling, a Monte Carlo approach specialised for model comparison, and exploits proximal Markov chain Monte Carlo techniques to scale efficiently to large problems and to tackle models that are log-concave and not necessarily smooth (e.g., involving l_1 or total-variation priors). The proposed approach can be applied computationally to problems of dimension O(10^6) and beyond, making it suitable for high-dimensional inverse imaging problems. It is validated on large Gaussian models, for which the likelihood is available analytically, and subsequently illustrated on a range of imaging problems where it is used to analyse different choices of dictionary and measurement model.
title Proximal nested sampling for high-dimensional Bayesian model selection
topic Methodology
Instrumentation and Methods for Astrophysics
url https://arxiv.org/abs/2106.03646