Lower and Upper Expected Hitting Times for Weighted Imprecise Markov Chains
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914402369798144 |
|---|---|
| author | Sangalli, Marco Krak, Thomas |
| author_facet | Sangalli, Marco Krak, Thomas |
| contents | In this paper, we extend hitting times for imprecise Markov chains to the framework of weighted imprecise Markov chains (WIMCs), in which each transition is associated with a strictly positive weight encoded by a matrix $W$. Given a convex set $\mathcal{T}$ of admissible transition matrices, we define lower and upper expected hitting times for WIMCs as the infimum and supremum of the (weighted) expected hitting times over $\mathcal{T}$, and we characterise these quantities as the unique solutions of nonlinear fixed-point equations. We show that any weighted hitting time problem can be transformed into an unweighted hitting time problem on an augmented state space, enabling the reuse of existing IMC theory and algorithms. In particular, we are able to adapt known iterative methods for the numerical computation of expected hitting times for WIMCs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_16665 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Lower and Upper Expected Hitting Times for Weighted Imprecise Markov Chains Sangalli, Marco Krak, Thomas Probability In this paper, we extend hitting times for imprecise Markov chains to the framework of weighted imprecise Markov chains (WIMCs), in which each transition is associated with a strictly positive weight encoded by a matrix $W$. Given a convex set $\mathcal{T}$ of admissible transition matrices, we define lower and upper expected hitting times for WIMCs as the infimum and supremum of the (weighted) expected hitting times over $\mathcal{T}$, and we characterise these quantities as the unique solutions of nonlinear fixed-point equations. We show that any weighted hitting time problem can be transformed into an unweighted hitting time problem on an augmented state space, enabling the reuse of existing IMC theory and algorithms. In particular, we are able to adapt known iterative methods for the numerical computation of expected hitting times for WIMCs. |
| title | Lower and Upper Expected Hitting Times for Weighted Imprecise Markov Chains |
| topic | Probability |
| url | https://arxiv.org/abs/2603.16665 |