Interpretable Vital Sign Forecasting with Model Agnostic Attention Maps

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liu, Yuwei, Dan, Chen, Bhatti, Anubhav, Shen, Bingjie, Gupta, Divij, Parmar, Suraj, Lee, San
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909208031526912
author Liu, Yuwei
Dan, Chen
Bhatti, Anubhav
Shen, Bingjie
Gupta, Divij
Parmar, Suraj
Lee, San
author_facet Liu, Yuwei
Dan, Chen
Bhatti, Anubhav
Shen, Bingjie
Gupta, Divij
Parmar, Suraj
Lee, San
contents Sepsis is a leading cause of mortality in intensive care units (ICUs), representing a substantial medical challenge. The complexity of analyzing diverse vital signs to predict sepsis further aggravates this issue. While deep learning techniques have been advanced for early sepsis prediction, their 'black-box' nature obscures the internal logic, impairing interpretability in critical settings like ICUs. This paper introduces a framework that combines a deep learning model with an attention mechanism that highlights the critical time steps in the forecasting process, thus improving model interpretability and supporting clinical decision-making. We show that the attention mechanism could be adapted to various black box time series forecasting models such as N-HiTS and N-BEATS. Our method preserves the accuracy of conventional deep learning models while enhancing interpretability through attention-weight-generated heatmaps. We evaluated our model on the eICU-CRD dataset, focusing on forecasting vital signs for sepsis patients. We assessed its performance using mean squared error (MSE) and dynamic time warping (DTW) metrics. We explored the attention maps of N-HiTS and N-BEATS, examining the differences in their performance and identifying crucial factors influencing vital sign forecasting.
format Preprint
id arxiv_https___arxiv_org_abs_2405_01714
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Interpretable Vital Sign Forecasting with Model Agnostic Attention Maps
Liu, Yuwei
Dan, Chen
Bhatti, Anubhav
Shen, Bingjie
Gupta, Divij
Parmar, Suraj
Lee, San
Machine Learning
Artificial Intelligence
Sepsis is a leading cause of mortality in intensive care units (ICUs), representing a substantial medical challenge. The complexity of analyzing diverse vital signs to predict sepsis further aggravates this issue. While deep learning techniques have been advanced for early sepsis prediction, their 'black-box' nature obscures the internal logic, impairing interpretability in critical settings like ICUs. This paper introduces a framework that combines a deep learning model with an attention mechanism that highlights the critical time steps in the forecasting process, thus improving model interpretability and supporting clinical decision-making. We show that the attention mechanism could be adapted to various black box time series forecasting models such as N-HiTS and N-BEATS. Our method preserves the accuracy of conventional deep learning models while enhancing interpretability through attention-weight-generated heatmaps. We evaluated our model on the eICU-CRD dataset, focusing on forecasting vital signs for sepsis patients. We assessed its performance using mean squared error (MSE) and dynamic time warping (DTW) metrics. We explored the attention maps of N-HiTS and N-BEATS, examining the differences in their performance and identifying crucial factors influencing vital sign forecasting.
title Interpretable Vital Sign Forecasting with Model Agnostic Attention Maps
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2405.01714