Scaling of Piecewise Deterministic Monte Carlo for Anisotropic Targets
Fuente:
arXiv
Salvato in:
| Autori principali: | , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2023
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866913558483173376 |
|---|---|
| author | Bierkens, Joris Kamatani, Kengo Roberts, Gareth O. |
| author_facet | Bierkens, Joris Kamatani, Kengo Roberts, Gareth O. |
| contents | Piecewise deterministic Markov processes (PDMPs) are a type of continuous-time Markov process that combine deterministic flows with jumps. Recently, PDMPs have garnered attention within the Monte Carlo community as a potential alternative to traditional Markov chain Monte Carlo (MCMC) methods. The Zig-Zag sampler and the Bouncy Particle Sampler are commonly used examples of the PDMP methodology which have also yielded impressive theoretical properties, but little is known about their robustness to extreme dependence or anisotropy of the target density. It turns out that PDMPs may suffer from poor mixing due to anisotropy and this paper investigates this effect in detail in the stylised but important Gaussian case. To this end, we employ a multi-scale analysis framework in this paper. Our results show that when the Gaussian target distribution has two scales, of order $1$ and $ε$, the computational cost of the Bouncy Particle Sampler is of order $ε^{-1}$, and the computational cost of the Zig-Zag sampler is $ε^{-2}$. In comparison, the cost of the traditional MCMC methods such as RWM is of order $ε^{-2}$, at least when the dimensionality of the small component is more than $1$. Therefore, there is a robustness advantage to using PDMPs in this context. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2305_00694 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Scaling of Piecewise Deterministic Monte Carlo for Anisotropic Targets Bierkens, Joris Kamatani, Kengo Roberts, Gareth O. Methodology Computation Piecewise deterministic Markov processes (PDMPs) are a type of continuous-time Markov process that combine deterministic flows with jumps. Recently, PDMPs have garnered attention within the Monte Carlo community as a potential alternative to traditional Markov chain Monte Carlo (MCMC) methods. The Zig-Zag sampler and the Bouncy Particle Sampler are commonly used examples of the PDMP methodology which have also yielded impressive theoretical properties, but little is known about their robustness to extreme dependence or anisotropy of the target density. It turns out that PDMPs may suffer from poor mixing due to anisotropy and this paper investigates this effect in detail in the stylised but important Gaussian case. To this end, we employ a multi-scale analysis framework in this paper. Our results show that when the Gaussian target distribution has two scales, of order $1$ and $ε$, the computational cost of the Bouncy Particle Sampler is of order $ε^{-1}$, and the computational cost of the Zig-Zag sampler is $ε^{-2}$. In comparison, the cost of the traditional MCMC methods such as RWM is of order $ε^{-2}$, at least when the dimensionality of the small component is more than $1$. Therefore, there is a robustness advantage to using PDMPs in this context. |
| title | Scaling of Piecewise Deterministic Monte Carlo for Anisotropic Targets |
| topic | Methodology Computation |
| url | https://arxiv.org/abs/2305.00694 |