DeltaSHAP: Explaining Prediction Evolutions in Online Patient Monitoring with Shapley Values

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kim, Changhun, Mun, Yechan, Hahn, Sangchul, Yang, Eunho
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911052501876736
author Kim, Changhun
Mun, Yechan
Hahn, Sangchul
Yang, Eunho
author_facet Kim, Changhun
Mun, Yechan
Hahn, Sangchul
Yang, Eunho
contents This study proposes DeltaSHAP, a novel explainable artificial intelligence (XAI) algorithm specifically designed for online patient monitoring systems. In clinical environments, discovering the causes driving patient risk evolution is critical for timely intervention, yet existing XAI methods fail to address the unique requirements of clinical time series explanation tasks. To this end, DeltaSHAP addresses three key clinical needs: explaining the changes in the consecutive predictions rather than isolated prediction scores, providing both magnitude and direction of feature attributions, and delivering these insights in real time. By adapting Shapley values to temporal settings, our approach accurately captures feature coalition effects. It further attributes prediction changes using only the actually observed feature combinations, making it efficient and practical for time-sensitive clinical applications. We also introduce new evaluation metrics to evaluate the faithfulness of the attributions for online time series, and demonstrate through experiments on online patient monitoring tasks that DeltaSHAP outperforms state-of-the-art XAI methods in both explanation quality as 62% and computational efficiency as 33% time reduction on the MIMIC-III decompensation benchmark. We release our code at https://github.com/AITRICS/DeltaSHAP.
format Preprint
id arxiv_https___arxiv_org_abs_2507_02342
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DeltaSHAP: Explaining Prediction Evolutions in Online Patient Monitoring with Shapley Values
Kim, Changhun
Mun, Yechan
Hahn, Sangchul
Yang, Eunho
Machine Learning
Artificial Intelligence
This study proposes DeltaSHAP, a novel explainable artificial intelligence (XAI) algorithm specifically designed for online patient monitoring systems. In clinical environments, discovering the causes driving patient risk evolution is critical for timely intervention, yet existing XAI methods fail to address the unique requirements of clinical time series explanation tasks. To this end, DeltaSHAP addresses three key clinical needs: explaining the changes in the consecutive predictions rather than isolated prediction scores, providing both magnitude and direction of feature attributions, and delivering these insights in real time. By adapting Shapley values to temporal settings, our approach accurately captures feature coalition effects. It further attributes prediction changes using only the actually observed feature combinations, making it efficient and practical for time-sensitive clinical applications. We also introduce new evaluation metrics to evaluate the faithfulness of the attributions for online time series, and demonstrate through experiments on online patient monitoring tasks that DeltaSHAP outperforms state-of-the-art XAI methods in both explanation quality as 62% and computational efficiency as 33% time reduction on the MIMIC-III decompensation benchmark. We release our code at https://github.com/AITRICS/DeltaSHAP.
title DeltaSHAP: Explaining Prediction Evolutions in Online Patient Monitoring with Shapley Values
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2507.02342