Saved in:
Bibliographic Details
Main Authors: Deshkar, Gaurav, Kshirsagar, Jayanta, Hayatnagarkar, Harshal, Venugopalan, Janani
Format: Preprint
Published: 2023
Subjects:
Online Access:https://arxiv.org/abs/2304.04475
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909728476495872
author Deshkar, Gaurav
Kshirsagar, Jayanta
Hayatnagarkar, Harshal
Venugopalan, Janani
author_facet Deshkar, Gaurav
Kshirsagar, Jayanta
Hayatnagarkar, Harshal
Venugopalan, Janani
contents To mitigate the impact of the pandemic, several measures include lockdowns, rapid vaccination programs, school closures, and economic stimulus. These interventions can have positive or unintended negative consequences. Current research to model and determine an optimal intervention automatically through round-tripping is limited by the simulation objectives, scale (a few thousand individuals), model types that are not suited for intervention studies, and the number of intervention strategies they can explore (discrete vs continuous). We address these challenges using a Deep Deterministic Policy Gradient (DDPG) based policy optimization framework on a large-scale (100,000 individual) epidemiological agent-based simulation where we perform multi-objective optimization. We determine the optimal policy for lockdown and vaccination in a minimalist age-stratified multi-vaccine scenario with a basic simulation for economic activity. With no lockdown and vaccination (mid-age and elderly), results show optimal economy (individuals below the poverty line) with balanced health objectives (infection, and hospitalization). An in-depth simulation is needed to further validate our results and open-source our framework.
format Preprint
id arxiv_https___arxiv_org_abs_2304_04475
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Epidemic Control on a Large-Scale-Agent-Based Epidemiology Model using Deep Deterministic Policy Gradient
Deshkar, Gaurav
Kshirsagar, Jayanta
Hayatnagarkar, Harshal
Venugopalan, Janani
Machine Learning
Artificial Intelligence
Systems and Control
To mitigate the impact of the pandemic, several measures include lockdowns, rapid vaccination programs, school closures, and economic stimulus. These interventions can have positive or unintended negative consequences. Current research to model and determine an optimal intervention automatically through round-tripping is limited by the simulation objectives, scale (a few thousand individuals), model types that are not suited for intervention studies, and the number of intervention strategies they can explore (discrete vs continuous). We address these challenges using a Deep Deterministic Policy Gradient (DDPG) based policy optimization framework on a large-scale (100,000 individual) epidemiological agent-based simulation where we perform multi-objective optimization. We determine the optimal policy for lockdown and vaccination in a minimalist age-stratified multi-vaccine scenario with a basic simulation for economic activity. With no lockdown and vaccination (mid-age and elderly), results show optimal economy (individuals below the poverty line) with balanced health objectives (infection, and hospitalization). An in-depth simulation is needed to further validate our results and open-source our framework.
title Epidemic Control on a Large-Scale-Agent-Based Epidemiology Model using Deep Deterministic Policy Gradient
topic Machine Learning
Artificial Intelligence
Systems and Control
url https://arxiv.org/abs/2304.04475