Salvato in:
Dettagli Bibliografici
Autori principali: Iannucci, Giacomo, Barmpounakis, Petros, Beskos, Alexandros, Demiris, Nikolaos
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:https://arxiv.org/abs/2511.18035
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908669697851392
author Iannucci, Giacomo
Barmpounakis, Petros
Beskos, Alexandros
Demiris, Nikolaos
author_facet Iannucci, Giacomo
Barmpounakis, Petros
Beskos, Alexandros
Demiris, Nikolaos
contents This paper presents a real time, data driven decision support framework for epidemic control. We combine a compartmental epidemic model with sequential Bayesian inference and reinforcement learning (RL) controllers that adaptively choose intervention levels to balance disease burden, such as intensive care unit (ICU) load, against socio economic costs. We construct a context specific cost function using empirical experiments and expert feedback. We study two RL policies: an ICU threshold rule computed via Monte Carlo grid search, and a policy based on a posterior averaged Q learning agent. We validate the framework by fitting the epidemic model to publicly available ICU occupancy data from the COVID 19 pandemic in England and then generating counterfactual roll out scenarios under each RL controller, which allows us to compare the RL policies to the historical government strategy. Over a 300 day period and for a range of cost parameters, both controllers substantially reduce ICU burden relative to the observed interventions, illustrating how Bayesian sequential learning combined with RL can support the design of epidemic control policies.
format Preprint
id arxiv_https___arxiv_org_abs_2511_18035
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle On a Reinforcement Learning Methodology for Epidemic Control, with application to COVID-19
Iannucci, Giacomo
Barmpounakis, Petros
Beskos, Alexandros
Demiris, Nikolaos
Methodology
Machine Learning
Computation
62M10, 62P10, 90C40
This paper presents a real time, data driven decision support framework for epidemic control. We combine a compartmental epidemic model with sequential Bayesian inference and reinforcement learning (RL) controllers that adaptively choose intervention levels to balance disease burden, such as intensive care unit (ICU) load, against socio economic costs. We construct a context specific cost function using empirical experiments and expert feedback. We study two RL policies: an ICU threshold rule computed via Monte Carlo grid search, and a policy based on a posterior averaged Q learning agent. We validate the framework by fitting the epidemic model to publicly available ICU occupancy data from the COVID 19 pandemic in England and then generating counterfactual roll out scenarios under each RL controller, which allows us to compare the RL policies to the historical government strategy. Over a 300 day period and for a range of cost parameters, both controllers substantially reduce ICU burden relative to the observed interventions, illustrating how Bayesian sequential learning combined with RL can support the design of epidemic control policies.
title On a Reinforcement Learning Methodology for Epidemic Control, with application to COVID-19
topic Methodology
Machine Learning
Computation
62M10, 62P10, 90C40
url https://arxiv.org/abs/2511.18035