Use Model Averaging instead of Model Selection in Pulsar Timing

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autor principal: van Haasteren, Rutger
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909405927178240
author van Haasteren, Rutger
author_facet van Haasteren, Rutger
contents Over the past decade and a half, adoption of Bayesian inference in pulsar timing analysis has led to increasingly sophisticated models. The recent announcement of evidence for a stochastic background of gravitational waves by various pulsar timing array projects highlighted Bayesian inference as a central tool for parameter estimation and model selection. Despite its success, Bayesian inference is occasionally misused in the pulsar timing community. A common workflow is that the data is analyzed in multiple steps: a first analysis of single pulsars individually, and a subsequent analysis of the whole array of pulsars. A mistake that is then sometimes introduced stems from using the posterior distribution to craft the prior for the analysis of the same data in a second step, a practice referred to in the statistics literature as ``circular analysis.'' This is done to prune the model for computational efficiency. Multiple recent high-profile searches for gravitational waves by pulsar timing array (PTA) projects have this workflow. This letter highlights this error and suggests that Spike and Slab priors can be used to carry out model averaging instead of model selection in a single pass. Spike and Slab priors are proved to be equal to Log-Uniform priors.
format Preprint
id arxiv_https___arxiv_org_abs_2409_06050
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Use Model Averaging instead of Model Selection in Pulsar Timing
van Haasteren, Rutger
Instrumentation and Methods for Astrophysics
General Relativity and Quantum Cosmology
Over the past decade and a half, adoption of Bayesian inference in pulsar timing analysis has led to increasingly sophisticated models. The recent announcement of evidence for a stochastic background of gravitational waves by various pulsar timing array projects highlighted Bayesian inference as a central tool for parameter estimation and model selection. Despite its success, Bayesian inference is occasionally misused in the pulsar timing community. A common workflow is that the data is analyzed in multiple steps: a first analysis of single pulsars individually, and a subsequent analysis of the whole array of pulsars. A mistake that is then sometimes introduced stems from using the posterior distribution to craft the prior for the analysis of the same data in a second step, a practice referred to in the statistics literature as ``circular analysis.'' This is done to prune the model for computational efficiency. Multiple recent high-profile searches for gravitational waves by pulsar timing array (PTA) projects have this workflow. This letter highlights this error and suggests that Spike and Slab priors can be used to carry out model averaging instead of model selection in a single pass. Spike and Slab priors are proved to be equal to Log-Uniform priors.
title Use Model Averaging instead of Model Selection in Pulsar Timing
topic Instrumentation and Methods for Astrophysics
General Relativity and Quantum Cosmology
url https://arxiv.org/abs/2409.06050