Langevin dynamics for the probability of finite state Markov processes
Fuente:
arXiv
Saved in:
| Main Author: | |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912034386345984 |
|---|---|
| author | Li, Wuchen |
| author_facet | Li, Wuchen |
| contents | We study gradient drift-diffusion processes on a probability simplex set with finite state Wasserstein metrics, namely finite state Wasserstein common noises. A fact is that the Kolmogorov transition equation of finite reversible Markov processes satisfies the gradient flow of entropy in finite state Wasserstein space. This paper proposes to perturb finite state Markov processes with Wasserstein common noises. In this way, we introduce a class of stochastic reversible Markov processes. We also define stochastic transition rate matrices, namely Wasserstein Q-matrices, for the proposed stochastic Markov processes. We then derive the functional Fokker-Planck equation in the probability simplex, whose stationary distribution is a Gibbs distribution of entropy functional in a simplex set. Several examples of Wasserstein drift-diffusion processes on a two-point state space are presented. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2307_00678 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Langevin dynamics for the probability of finite state Markov processes Li, Wuchen Probability Optimization and Control We study gradient drift-diffusion processes on a probability simplex set with finite state Wasserstein metrics, namely finite state Wasserstein common noises. A fact is that the Kolmogorov transition equation of finite reversible Markov processes satisfies the gradient flow of entropy in finite state Wasserstein space. This paper proposes to perturb finite state Markov processes with Wasserstein common noises. In this way, we introduce a class of stochastic reversible Markov processes. We also define stochastic transition rate matrices, namely Wasserstein Q-matrices, for the proposed stochastic Markov processes. We then derive the functional Fokker-Planck equation in the probability simplex, whose stationary distribution is a Gibbs distribution of entropy functional in a simplex set. Several examples of Wasserstein drift-diffusion processes on a two-point state space are presented. |
| title | Langevin dynamics for the probability of finite state Markov processes |
| topic | Probability Optimization and Control |
| url | https://arxiv.org/abs/2307.00678 |