Self-explaining Neural Network with Concept-based Explanations for ICU Mortality Prediction

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Kumar, Sayantan, Yu, Sean C., Kannampallil, Thomas, Abrams, Zachary, Michelson, Andrew, Payne, Philip R. O.
Format: Preprint
Publié: 2021
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866918324013629440
author Kumar, Sayantan
Yu, Sean C.
Kannampallil, Thomas
Abrams, Zachary
Michelson, Andrew
Payne, Philip R. O.
author_facet Kumar, Sayantan
Yu, Sean C.
Kannampallil, Thomas
Abrams, Zachary
Michelson, Andrew
Payne, Philip R. O.
contents Complex deep learning models show high prediction tasks in various clinical prediction tasks but their inherent complexity makes it more challenging to explain model predictions for clinicians and healthcare providers. Existing research on explainability of deep learning models in healthcare have two major limitations: using post-hoc explanations and using raw clinical variables as units of explanation, both of which are often difficult for human interpretation. In this work, we designed a self-explaining deep learning framework using the expert-knowledge driven clinical concepts or intermediate features as units of explanation. The self-explaining nature of our proposed model comes from generating both explanations and predictions within the same architectural framework via joint training. We tested our proposed approach on a publicly available Electronic Health Records (EHR) dataset for predicting patient mortality in the ICU. In order to analyze the performance-interpretability trade-off, we compared our proposed model with a baseline having the same set-up but without the explanation components. Experimental results suggest that adding explainability components to a deep learning framework does not impact prediction performance and the explanations generated by the model can provide insights to the clinicians to understand the possible reasons behind patient mortality.
format Preprint
id arxiv_https___arxiv_org_abs_2110_04598
institution arXiv
publishDate 2021
record_format arxiv
spellingShingle Self-explaining Neural Network with Concept-based Explanations for ICU Mortality Prediction
Kumar, Sayantan
Yu, Sean C.
Kannampallil, Thomas
Abrams, Zachary
Michelson, Andrew
Payne, Philip R. O.
Machine Learning
Complex deep learning models show high prediction tasks in various clinical prediction tasks but their inherent complexity makes it more challenging to explain model predictions for clinicians and healthcare providers. Existing research on explainability of deep learning models in healthcare have two major limitations: using post-hoc explanations and using raw clinical variables as units of explanation, both of which are often difficult for human interpretation. In this work, we designed a self-explaining deep learning framework using the expert-knowledge driven clinical concepts or intermediate features as units of explanation. The self-explaining nature of our proposed model comes from generating both explanations and predictions within the same architectural framework via joint training. We tested our proposed approach on a publicly available Electronic Health Records (EHR) dataset for predicting patient mortality in the ICU. In order to analyze the performance-interpretability trade-off, we compared our proposed model with a baseline having the same set-up but without the explanation components. Experimental results suggest that adding explainability components to a deep learning framework does not impact prediction performance and the explanations generated by the model can provide insights to the clinicians to understand the possible reasons behind patient mortality.
title Self-explaining Neural Network with Concept-based Explanations for ICU Mortality Prediction
topic Machine Learning
url https://arxiv.org/abs/2110.04598