Quasi-stationary distributions of non-absorbing Markov chains
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866929519766536192 |
|---|---|
| author | Fernandez, Roberto Manzo, Francesco Quattropani, Matteo Scoppola, Elisabetta |
| author_facet | Fernandez, Roberto Manzo, Francesco Quattropani, Matteo Scoppola, Elisabetta |
| contents | We consider reversible ergodic Markov chains with finite state space, and we introduce a new notion of quasi-stationary distribution that does not require the presence of any absorbing state. In our setting, the hitting time of the absorbing set is replaced by an optimal strong stationary time, representing the ``hitting time of the stationary distribution''. On the one hand, we show that our notion of quasi-stationary distribution corresponds to the natural generalization of the \emph{Yaglom limit}. On the other hand, similarly to the classical quasi-stationary distribution, we show that it can be written in terms of the eigenvectors of the underlying Markov kernel, and it is therefore amenable of a geometric interpretation. Moreover, we recover the usual exponential behavior that characterizes quasi-stationary distributions and metastable systems. We also provide some toy examples, which show that the phenomenology is richer compared to the absorbing case. Finally, we present some counterexamples, showing that the assumption on the reversibility cannot be weakened in general. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_19246 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Quasi-stationary distributions of non-absorbing Markov chains Fernandez, Roberto Manzo, Francesco Quattropani, Matteo Scoppola, Elisabetta Probability Mathematical Physics We consider reversible ergodic Markov chains with finite state space, and we introduce a new notion of quasi-stationary distribution that does not require the presence of any absorbing state. In our setting, the hitting time of the absorbing set is replaced by an optimal strong stationary time, representing the ``hitting time of the stationary distribution''. On the one hand, we show that our notion of quasi-stationary distribution corresponds to the natural generalization of the \emph{Yaglom limit}. On the other hand, similarly to the classical quasi-stationary distribution, we show that it can be written in terms of the eigenvectors of the underlying Markov kernel, and it is therefore amenable of a geometric interpretation. Moreover, we recover the usual exponential behavior that characterizes quasi-stationary distributions and metastable systems. We also provide some toy examples, which show that the phenomenology is richer compared to the absorbing case. Finally, we present some counterexamples, showing that the assumption on the reversibility cannot be weakened in general. |
| title | Quasi-stationary distributions of non-absorbing Markov chains |
| topic | Probability Mathematical Physics |
| url | https://arxiv.org/abs/2409.19246 |