Adaptive Interventions with User-Defined Goals for Health Behavior Change

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Mandyam, Aishwarya, Jörke, Matthew, Denton, William, Engelhardt, Barbara E., Brunskill, Emma
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914805856600064
author Mandyam, Aishwarya
Jörke, Matthew
Denton, William
Engelhardt, Barbara E.
Brunskill, Emma
author_facet Mandyam, Aishwarya
Jörke, Matthew
Denton, William
Engelhardt, Barbara E.
Brunskill, Emma
contents Promoting healthy lifestyle behaviors remains a major public health concern, particularly due to their crucial role in preventing chronic conditions such as cancer, heart disease, and type 2 diabetes. Mobile health applications present a promising avenue for low-cost, scalable health behavior change promotion. Researchers are increasingly exploring adaptive algorithms that personalize interventions to each person's unique context. However, in empirical studies, mobile health applications often suffer from small effect sizes and low adherence rates, particularly in comparison to human coaching. Tailoring advice to a person's unique goals, preferences, and life circumstances is a critical component of health coaching that has been underutilized in adaptive algorithms for mobile health interventions. To address this, we introduce a new Thompson sampling algorithm that can accommodate personalized reward functions (i.e., goals, preferences, and constraints), while also leveraging data sharing across individuals to more quickly be able to provide effective recommendations. We prove that our modification incurs only a constant penalty on cumulative regret while preserving the sample complexity benefits of data sharing. We present empirical results on synthetic and semi-synthetic physical activity simulators, where in the latter we conducted an online survey to solicit preference data relating to physical activity, which we use to construct realistic reward models that leverages historical data from another study. Our algorithm achieves substantial performance improvements compared to baselines that do not share data or do not optimize for individualized rewards.
format Preprint
id arxiv_https___arxiv_org_abs_2311_09483
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Adaptive Interventions with User-Defined Goals for Health Behavior Change
Mandyam, Aishwarya
Jörke, Matthew
Denton, William
Engelhardt, Barbara E.
Brunskill, Emma
Machine Learning
Artificial Intelligence
Promoting healthy lifestyle behaviors remains a major public health concern, particularly due to their crucial role in preventing chronic conditions such as cancer, heart disease, and type 2 diabetes. Mobile health applications present a promising avenue for low-cost, scalable health behavior change promotion. Researchers are increasingly exploring adaptive algorithms that personalize interventions to each person's unique context. However, in empirical studies, mobile health applications often suffer from small effect sizes and low adherence rates, particularly in comparison to human coaching. Tailoring advice to a person's unique goals, preferences, and life circumstances is a critical component of health coaching that has been underutilized in adaptive algorithms for mobile health interventions. To address this, we introduce a new Thompson sampling algorithm that can accommodate personalized reward functions (i.e., goals, preferences, and constraints), while also leveraging data sharing across individuals to more quickly be able to provide effective recommendations. We prove that our modification incurs only a constant penalty on cumulative regret while preserving the sample complexity benefits of data sharing. We present empirical results on synthetic and semi-synthetic physical activity simulators, where in the latter we conducted an online survey to solicit preference data relating to physical activity, which we use to construct realistic reward models that leverages historical data from another study. Our algorithm achieves substantial performance improvements compared to baselines that do not share data or do not optimize for individualized rewards.
title Adaptive Interventions with User-Defined Goals for Health Behavior Change
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2311.09483