Numerical methods for quasi-stationary distributions

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Oliver-Bonafoux, Sara, Aguilar, Javier, Galla, Tobias, Toral, Raúl
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914434972123136
author Oliver-Bonafoux, Sara
Aguilar, Javier
Galla, Tobias
Toral, Raúl
author_facet Oliver-Bonafoux, Sara
Aguilar, Javier
Galla, Tobias
Toral, Raúl
contents In stochastic processes with absorbing states, the quasi-stationary distribution provides valuable insights into the long-term behaviour prior to absorption. In this work, we revisit two well-established numerical methods for its computation. The first is an iterative algorithm for solving the non-linear equation that defines the quasi-stationary distribution. We generalise this technique to accommodate general Markov stochastic processes, either with discrete or continuous state space, and with multiple absorbing states. The second is a Monte Carlo method with resetting, for which we propose a novel single-trajectory approach that uses the trajectory's own history to perform resets after absorption. In addition to these methodological contributions, we provide a detailed analysis of implementation aspects for both methods. We also compare their accuracy and efficiency across a range of examples. The results indicate that the iterative algorithm is generally the preferred choice for problems with simple boundaries, while the Monte Carlo approach is more suitable for problems with complex boundaries, where the implementation of the iterative algorithm is a challenging task.
format Preprint
id arxiv_https___arxiv_org_abs_2510_02891
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Numerical methods for quasi-stationary distributions
Oliver-Bonafoux, Sara
Aguilar, Javier
Galla, Tobias
Toral, Raúl
Statistical Mechanics
Mathematical Physics
In stochastic processes with absorbing states, the quasi-stationary distribution provides valuable insights into the long-term behaviour prior to absorption. In this work, we revisit two well-established numerical methods for its computation. The first is an iterative algorithm for solving the non-linear equation that defines the quasi-stationary distribution. We generalise this technique to accommodate general Markov stochastic processes, either with discrete or continuous state space, and with multiple absorbing states. The second is a Monte Carlo method with resetting, for which we propose a novel single-trajectory approach that uses the trajectory's own history to perform resets after absorption. In addition to these methodological contributions, we provide a detailed analysis of implementation aspects for both methods. We also compare their accuracy and efficiency across a range of examples. The results indicate that the iterative algorithm is generally the preferred choice for problems with simple boundaries, while the Monte Carlo approach is more suitable for problems with complex boundaries, where the implementation of the iterative algorithm is a challenging task.
title Numerical methods for quasi-stationary distributions
topic Statistical Mechanics
Mathematical Physics
url https://arxiv.org/abs/2510.02891