Saved in:
Bibliographic Details
Main Authors: Tiomela, Romario Gildas Foko, Alagbe, Samson Adekola, Lawal, Olawale Nasiru, Talla, Serges Love Teutu, Kemajou-Brown, Isabella
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2505.21519
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908466106335232
author Tiomela, Romario Gildas Foko
Alagbe, Samson Adekola
Lawal, Olawale Nasiru
Talla, Serges Love Teutu
Kemajou-Brown, Isabella
author_facet Tiomela, Romario Gildas Foko
Alagbe, Samson Adekola
Lawal, Olawale Nasiru
Talla, Serges Love Teutu
Kemajou-Brown, Isabella
contents This study introduces a comparative modeling framework using stationary and non-stationary transition probabilities within a Markov Decision Process (MDP) to assess COVID-19 disease dynamics. Stationary transition probabilities assume constant transition rates, while non-stationary transitions reflect time-dependent behaviors including policy interventions or behavioral changes. We develop a comprehensive compartmental model with transitions based on binomial and multinomial processes. Mathematical models for both stationary and non-stationary transition frameworks are developed and simulated over a 365-day period to emphasize dynamic variations in epidemic outcomes. Our findings highlight the significance of non-stationary modeling in accurately representing the dynamic characteristics of pandemic situations and provide recommendations for optimizing public health interventions under uncertainty. This comparative analysis offers useful information for epidemiological modeling and decision-making in dynamic risk environments.
format Preprint
id arxiv_https___arxiv_org_abs_2505_21519
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Stationary and Non-Stationary Transition Probabilities in Decision Making: Modeling COVID-19 Dynamics
Tiomela, Romario Gildas Foko
Alagbe, Samson Adekola
Lawal, Olawale Nasiru
Talla, Serges Love Teutu
Kemajou-Brown, Isabella
Physics and Society
Populations and Evolution
37A50, 37M25, 90C40, 92D30
This study introduces a comparative modeling framework using stationary and non-stationary transition probabilities within a Markov Decision Process (MDP) to assess COVID-19 disease dynamics. Stationary transition probabilities assume constant transition rates, while non-stationary transitions reflect time-dependent behaviors including policy interventions or behavioral changes. We develop a comprehensive compartmental model with transitions based on binomial and multinomial processes. Mathematical models for both stationary and non-stationary transition frameworks are developed and simulated over a 365-day period to emphasize dynamic variations in epidemic outcomes. Our findings highlight the significance of non-stationary modeling in accurately representing the dynamic characteristics of pandemic situations and provide recommendations for optimizing public health interventions under uncertainty. This comparative analysis offers useful information for epidemiological modeling and decision-making in dynamic risk environments.
title Stationary and Non-Stationary Transition Probabilities in Decision Making: Modeling COVID-19 Dynamics
topic Physics and Society
Populations and Evolution
37A50, 37M25, 90C40, 92D30
url https://arxiv.org/abs/2505.21519