Estimation of An Infinite Dimensional Transition Probability Matrix Using a Generalized Hierarchical Stick-Breaking Process
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866918088180498432 |
|---|---|
| author | Saha, Agamani Roy, Souvik |
| author_facet | Saha, Agamani Roy, Souvik |
| contents | Markov chains provide a foundational framework for modeling sequential stochastic processes, with the transition probability matrix characterizing the dynamics of state evolution. While classical estimation methods such as maximum likelihood and empirical Bayes approaches are effective in finite-state settings, they become inadequate in applications involving countably infinite or dynamically expanding state spaces, which frequently arise in domains such as natural language processing, population dynamics, and behavioral modeling. In this work, we introduce a novel Bayesian nonparametric framework for estimating infinite-dimensional transition probability matrices by employing a new class of priors, termed the Generalized Hierarchical Stick-Breaking prior. This prior extends traditional Dirichlet process and stick-breaking constructions, enabling highly flexible modelling of transition probability matrices. The proposed approach offers a principled methodology for inferring transition probabilities in settings characterized by sparsity, high dimensionality, and unobserved state spaces, thereby contributing to the advancement of statistical inference for infinite-dimensional transition probability matrices. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_07433 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Estimation of An Infinite Dimensional Transition Probability Matrix Using a Generalized Hierarchical Stick-Breaking Process Saha, Agamani Roy, Souvik Methodology Applications Markov chains provide a foundational framework for modeling sequential stochastic processes, with the transition probability matrix characterizing the dynamics of state evolution. While classical estimation methods such as maximum likelihood and empirical Bayes approaches are effective in finite-state settings, they become inadequate in applications involving countably infinite or dynamically expanding state spaces, which frequently arise in domains such as natural language processing, population dynamics, and behavioral modeling. In this work, we introduce a novel Bayesian nonparametric framework for estimating infinite-dimensional transition probability matrices by employing a new class of priors, termed the Generalized Hierarchical Stick-Breaking prior. This prior extends traditional Dirichlet process and stick-breaking constructions, enabling highly flexible modelling of transition probability matrices. The proposed approach offers a principled methodology for inferring transition probabilities in settings characterized by sparsity, high dimensionality, and unobserved state spaces, thereby contributing to the advancement of statistical inference for infinite-dimensional transition probability matrices. |
| title | Estimation of An Infinite Dimensional Transition Probability Matrix Using a Generalized Hierarchical Stick-Breaking Process |
| topic | Methodology Applications |
| url | https://arxiv.org/abs/2507.07433 |