Optimizing Warfarin Dosing Using Contextual Bandit: An Offline Policy Learning and Evaluation Method

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Huang, Yong, Downs, Charles A., Rahmani, Amir M.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929246490853376
author Huang, Yong
Downs, Charles A.
Rahmani, Amir M.
author_facet Huang, Yong
Downs, Charles A.
Rahmani, Amir M.
contents Warfarin, an anticoagulant medication, is formulated to prevent and address conditions associated with abnormal blood clotting, making it one of the most prescribed drugs globally. However, determining the suitable dosage remains challenging due to individual response variations, and prescribing an incorrect dosage may lead to severe consequences. Contextual bandit and reinforcement learning have shown promise in addressing this issue. Given the wide availability of observational data and safety concerns of decision-making in healthcare, we focused on using exclusively observational data from historical policies as demonstrations to derive new policies; we utilized offline policy learning and evaluation in a contextual bandit setting to establish the optimal personalized dosage strategy. Our learned policies surpassed these baseline approaches without genotype inputs, even when given a suboptimal demonstration, showcasing promising application potential.
format Preprint
id arxiv_https___arxiv_org_abs_2402_11123
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Optimizing Warfarin Dosing Using Contextual Bandit: An Offline Policy Learning and Evaluation Method
Huang, Yong
Downs, Charles A.
Rahmani, Amir M.
Machine Learning
Artificial Intelligence
Warfarin, an anticoagulant medication, is formulated to prevent and address conditions associated with abnormal blood clotting, making it one of the most prescribed drugs globally. However, determining the suitable dosage remains challenging due to individual response variations, and prescribing an incorrect dosage may lead to severe consequences. Contextual bandit and reinforcement learning have shown promise in addressing this issue. Given the wide availability of observational data and safety concerns of decision-making in healthcare, we focused on using exclusively observational data from historical policies as demonstrations to derive new policies; we utilized offline policy learning and evaluation in a contextual bandit setting to establish the optimal personalized dosage strategy. Our learned policies surpassed these baseline approaches without genotype inputs, even when given a suboptimal demonstration, showcasing promising application potential.
title Optimizing Warfarin Dosing Using Contextual Bandit: An Offline Policy Learning and Evaluation Method
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2402.11123