Saved in:
Bibliographic Details
Main Authors: Mustafa, Yasmine, Luo, Tie
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2402.16008
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929256535162880
author Mustafa, Yasmine
Luo, Tie
author_facet Mustafa, Yasmine
Luo, Tie
contents The evolution of deep learning and artificial intelligence has significantly reshaped technological landscapes. However, their effective application in crucial sectors such as medicine demands more than just superior performance, but trustworthiness as well. While interpretability plays a pivotal role, existing explainable AI (XAI) approaches often do not reveal {\em Clever Hans} behavior where a model makes (ungeneralizable) correct predictions using spurious correlations or biases in data. Likewise, current post-hoc XAI methods are susceptible to generating unjustified counterfactual examples. In this paper, we approach XAI with an innovative {\em model debugging} methodology realized through Jacobian Saliency Map (JSM). To cast the problem into a concrete context, we employ Alzheimer's disease (AD) diagnosis as the use case, motivated by its significant impact on human lives and the formidable challenge in its early detection, stemming from the intricate nature of its progression. We introduce an interpretable, multimodal model for AD classification over its multi-stage progression, incorporating JSM as a modality-agnostic tool that provides insights into volumetric changes indicative of brain abnormalities. Our extensive evaluation including ablation study manifests the efficacy of using JSM for model debugging and interpretation, while significantly enhancing model accuracy as well.
format Preprint
id arxiv_https___arxiv_org_abs_2402_16008
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Unmasking Dementia Detection by Masking Input Gradients: A JSM Approach to Model Interpretability and Precision
Mustafa, Yasmine
Luo, Tie
Computer Vision and Pattern Recognition
Machine Learning
The evolution of deep learning and artificial intelligence has significantly reshaped technological landscapes. However, their effective application in crucial sectors such as medicine demands more than just superior performance, but trustworthiness as well. While interpretability plays a pivotal role, existing explainable AI (XAI) approaches often do not reveal {\em Clever Hans} behavior where a model makes (ungeneralizable) correct predictions using spurious correlations or biases in data. Likewise, current post-hoc XAI methods are susceptible to generating unjustified counterfactual examples. In this paper, we approach XAI with an innovative {\em model debugging} methodology realized through Jacobian Saliency Map (JSM). To cast the problem into a concrete context, we employ Alzheimer's disease (AD) diagnosis as the use case, motivated by its significant impact on human lives and the formidable challenge in its early detection, stemming from the intricate nature of its progression. We introduce an interpretable, multimodal model for AD classification over its multi-stage progression, incorporating JSM as a modality-agnostic tool that provides insights into volumetric changes indicative of brain abnormalities. Our extensive evaluation including ablation study manifests the efficacy of using JSM for model debugging and interpretation, while significantly enhancing model accuracy as well.
title Unmasking Dementia Detection by Masking Input Gradients: A JSM Approach to Model Interpretability and Precision
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2402.16008