The Limits of Perception: Analyzing Inconsistencies in Saliency Maps in XAI

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Stubbin, Anna, Chyrikov, Thompson, Zhao, Jim, Chajo, Christina
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913279422496768
author Stubbin, Anna
Chyrikov, Thompson
Zhao, Jim
Chajo, Christina
author_facet Stubbin, Anna
Chyrikov, Thompson
Zhao, Jim
Chajo, Christina
contents Explainable artificial intelligence (XAI) plays an indispensable role in demystifying the decision-making processes of AI, especially within the healthcare industry. Clinicians rely heavily on detailed reasoning when making a diagnosis, often CT scans for specific features that distinguish between benign and malignant lesions. A comprehensive diagnostic approach includes an evaluation of imaging results, patient observations, and clinical tests. The surge in deploying deep learning models as support systems in medical diagnostics has been significant, offering advances that traditional methods could not. However, the complexity and opacity of these models present a double-edged sword. As they operate as "black boxes," with their reasoning obscured and inaccessible, there's an increased risk of misdiagnosis, which can lead to patient harm. Hence, there is a pressing need to cultivate transparency within AI systems, ensuring that the rationale behind an AI's diagnostic recommendations is clear and understandable to medical practitioners. This shift towards transparency is not just beneficial -- it's a critical step towards responsible AI integration in healthcare, ensuring that AI aids rather than hinders medical professionals in their crucial work.
format Preprint
id arxiv_https___arxiv_org_abs_2403_15684
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle The Limits of Perception: Analyzing Inconsistencies in Saliency Maps in XAI
Stubbin, Anna
Chyrikov, Thompson
Zhao, Jim
Chajo, Christina
Computer Vision and Pattern Recognition
Explainable artificial intelligence (XAI) plays an indispensable role in demystifying the decision-making processes of AI, especially within the healthcare industry. Clinicians rely heavily on detailed reasoning when making a diagnosis, often CT scans for specific features that distinguish between benign and malignant lesions. A comprehensive diagnostic approach includes an evaluation of imaging results, patient observations, and clinical tests. The surge in deploying deep learning models as support systems in medical diagnostics has been significant, offering advances that traditional methods could not. However, the complexity and opacity of these models present a double-edged sword. As they operate as "black boxes," with their reasoning obscured and inaccessible, there's an increased risk of misdiagnosis, which can lead to patient harm. Hence, there is a pressing need to cultivate transparency within AI systems, ensuring that the rationale behind an AI's diagnostic recommendations is clear and understandable to medical practitioners. This shift towards transparency is not just beneficial -- it's a critical step towards responsible AI integration in healthcare, ensuring that AI aids rather than hinders medical professionals in their crucial work.
title The Limits of Perception: Analyzing Inconsistencies in Saliency Maps in XAI
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2403.15684