Barttender: An approachable & interpretable way to compare medical imaging and non-imaging data

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Singla, Ayush, Isaac, Shakson, Patel, Chirag J.
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929597921099776
author Singla, Ayush
Isaac, Shakson
Patel, Chirag J.
author_facet Singla, Ayush
Isaac, Shakson
Patel, Chirag J.
contents Imaging-based deep learning has transformed healthcare research, yet its clinical adoption remains limited due to challenges in comparing imaging models with traditional non-imaging and tabular data. To bridge this gap, we introduce Barttender, an interpretable framework that uses deep learning for the direct comparison of the utility of imaging versus non-imaging tabular data for tasks like disease prediction. Barttender converts non-imaging tabular features, such as scalar data from electronic health records, into grayscale bars, facilitating an interpretable and scalable deep learning based modeling of both data modalities. Our framework allows researchers to evaluate differences in utility through performance measures, as well as local (sample-level) and global (population-level) explanations. We introduce a novel measure to define global feature importances for image-based deep learning models, which we call gIoU. Experiments on the CheXpert and MIMIC datasets with chest X-rays and scalar data from electronic health records show that Barttender performs comparably to traditional methods and offers enhanced explainability using deep learning models.
format Preprint
id arxiv_https___arxiv_org_abs_2411_12707
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Barttender: An approachable & interpretable way to compare medical imaging and non-imaging data
Singla, Ayush
Isaac, Shakson
Patel, Chirag J.
Quantitative Methods
Computer Vision and Pattern Recognition
Imaging-based deep learning has transformed healthcare research, yet its clinical adoption remains limited due to challenges in comparing imaging models with traditional non-imaging and tabular data. To bridge this gap, we introduce Barttender, an interpretable framework that uses deep learning for the direct comparison of the utility of imaging versus non-imaging tabular data for tasks like disease prediction. Barttender converts non-imaging tabular features, such as scalar data from electronic health records, into grayscale bars, facilitating an interpretable and scalable deep learning based modeling of both data modalities. Our framework allows researchers to evaluate differences in utility through performance measures, as well as local (sample-level) and global (population-level) explanations. We introduce a novel measure to define global feature importances for image-based deep learning models, which we call gIoU. Experiments on the CheXpert and MIMIC datasets with chest X-rays and scalar data from electronic health records show that Barttender performs comparably to traditional methods and offers enhanced explainability using deep learning models.
title Barttender: An approachable & interpretable way to compare medical imaging and non-imaging data
topic Quantitative Methods
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2411.12707