Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2304.02109 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917716860862464 |
|---|---|
| author | Chlebicka, Iwona Łatuszyński, Krzysztof Miasojedow, Błażej |
| author_facet | Chlebicka, Iwona Łatuszyński, Krzysztof Miasojedow, Błażej |
| contents | Gibbs samplers are preeminent Markov chain Monte Carlo algorithms used in computational physics and statistical computing. Yet, their most fundamental properties, such as relations between convergence characteristics of their various versions, are not well understood.
In this paper we prove the solidarity of their spectral gaps: if any of the random scan or $d!$ deterministic scans has a~spectral gap then all of them have. Our methods rely on geometric interpretation of the Gibbs samplers as alternating projection algorithms and analysis of the rate of convergence in the von Neumann--Halperin method of cyclic alternating projections.
In addition, we provide a quantitative result: if the spectral gap of the random scan Gibbs sampler scales polynomially with dimension, so does the spectral gap of any of the deterministic scans. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2304_02109 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Solidarity of Gibbs Samplers: the spectral gap Chlebicka, Iwona Łatuszyński, Krzysztof Miasojedow, Błażej Computation Gibbs samplers are preeminent Markov chain Monte Carlo algorithms used in computational physics and statistical computing. Yet, their most fundamental properties, such as relations between convergence characteristics of their various versions, are not well understood. In this paper we prove the solidarity of their spectral gaps: if any of the random scan or $d!$ deterministic scans has a~spectral gap then all of them have. Our methods rely on geometric interpretation of the Gibbs samplers as alternating projection algorithms and analysis of the rate of convergence in the von Neumann--Halperin method of cyclic alternating projections. In addition, we provide a quantitative result: if the spectral gap of the random scan Gibbs sampler scales polynomially with dimension, so does the spectral gap of any of the deterministic scans. |
| title | Solidarity of Gibbs Samplers: the spectral gap |
| topic | Computation |
| url | https://arxiv.org/abs/2304.02109 |