Saved in:
Bibliographic Details
Main Authors: Li, Haoxiang, Qin, Qian
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2405.10194
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913352932917248
author Li, Haoxiang
Qin, Qian
author_facet Li, Haoxiang
Qin, Qian
contents Time in-homogeneous cyclic Markov chain Monte Carlo (MCMC) samplers, including deterministic scan Gibbs samplers and Metropolis within Gibbs samplers, are extensively used for sampling from multi-dimensional distributions. We establish a multivariate strong invariance principle (SIP) for Markov chains associated with these samplers. The rate of this SIP essentially aligns with the tightest rate available for time homogeneous Markov chains. The SIP implies the strong law of large numbers (SLLN) and the central limit theorem (CLT), and plays an essential role in uncertainty assessments. Using the SIP, we give conditions under which the multivariate batch means estimator for estimating the covariance matrix in the multivariate CLT is strongly consistent. Additionally, we provide conditions for a multivariate fixed volume sequential termination rule, which is associated with the concept of effective sample size (ESS), to be asymptotically valid. Our uncertainty assessment tools are demonstrated through various numerical experiments.
format Preprint
id arxiv_https___arxiv_org_abs_2405_10194
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Multivariate strong invariance principle and uncertainty assessment for time in-homogeneous cyclic MCMC samplers
Li, Haoxiang
Qin, Qian
Computation
Statistics Theory
Time in-homogeneous cyclic Markov chain Monte Carlo (MCMC) samplers, including deterministic scan Gibbs samplers and Metropolis within Gibbs samplers, are extensively used for sampling from multi-dimensional distributions. We establish a multivariate strong invariance principle (SIP) for Markov chains associated with these samplers. The rate of this SIP essentially aligns with the tightest rate available for time homogeneous Markov chains. The SIP implies the strong law of large numbers (SLLN) and the central limit theorem (CLT), and plays an essential role in uncertainty assessments. Using the SIP, we give conditions under which the multivariate batch means estimator for estimating the covariance matrix in the multivariate CLT is strongly consistent. Additionally, we provide conditions for a multivariate fixed volume sequential termination rule, which is associated with the concept of effective sample size (ESS), to be asymptotically valid. Our uncertainty assessment tools are demonstrated through various numerical experiments.
title Multivariate strong invariance principle and uncertainty assessment for time in-homogeneous cyclic MCMC samplers
topic Computation
Statistics Theory
url https://arxiv.org/abs/2405.10194