Reinforcement Learning in Modern Biostatistics: Constructing Optimal Adaptive Interventions

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Deliu, Nina, Williams, Joseph Jay, Chakraborty, Bibhas
Format: Preprint
Published: 2022
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909252414603264
author Deliu, Nina
Williams, Joseph Jay
Chakraborty, Bibhas
author_facet Deliu, Nina
Williams, Joseph Jay
Chakraborty, Bibhas
contents In recent years, reinforcement learning (RL) has acquired a prominent position in health-related sequential decision-making problems, gaining traction as a valuable tool for delivering adaptive interventions (AIs). However, in part due to a poor synergy between the methodological and the applied communities, its real-life application is still limited and its potential is still to be realized. To address this gap, our work provides the first unified technical survey on RL methods, complemented with case studies, for constructing various types of AIs in healthcare. In particular, using the common methodological umbrella of RL, we bridge two seemingly different AI domains, dynamic treatment regimes and just-in-time adaptive interventions in mobile health, highlighting similarities and differences between them and discussing the implications of using RL. Open problems and considerations for future research directions are outlined. Finally, we leverage our experience in designing case studies in both areas to showcase the significant collaborative opportunities between statistical, RL, and healthcare researchers in advancing AIs.
format Preprint
id arxiv_https___arxiv_org_abs_2203_02605
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Reinforcement Learning in Modern Biostatistics: Constructing Optimal Adaptive Interventions
Deliu, Nina
Williams, Joseph Jay
Chakraborty, Bibhas
Machine Learning
Applications
Methodology
In recent years, reinforcement learning (RL) has acquired a prominent position in health-related sequential decision-making problems, gaining traction as a valuable tool for delivering adaptive interventions (AIs). However, in part due to a poor synergy between the methodological and the applied communities, its real-life application is still limited and its potential is still to be realized. To address this gap, our work provides the first unified technical survey on RL methods, complemented with case studies, for constructing various types of AIs in healthcare. In particular, using the common methodological umbrella of RL, we bridge two seemingly different AI domains, dynamic treatment regimes and just-in-time adaptive interventions in mobile health, highlighting similarities and differences between them and discussing the implications of using RL. Open problems and considerations for future research directions are outlined. Finally, we leverage our experience in designing case studies in both areas to showcase the significant collaborative opportunities between statistical, RL, and healthcare researchers in advancing AIs.
title Reinforcement Learning in Modern Biostatistics: Constructing Optimal Adaptive Interventions
topic Machine Learning
Applications
Methodology
url https://arxiv.org/abs/2203.02605