Self-eXplainable AI for Medical Image Analysis: A Survey and New Outlooks

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Hou, Junlin, Liu, Sicen, Bie, Yequan, Wang, Hongmei, Tan, Andong, Luo, Luyang, Chen, Hao
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929592313315328
author Hou, Junlin
Liu, Sicen
Bie, Yequan
Wang, Hongmei
Tan, Andong
Luo, Luyang
Chen, Hao
author_facet Hou, Junlin
Liu, Sicen
Bie, Yequan
Wang, Hongmei
Tan, Andong
Luo, Luyang
Chen, Hao
contents The increasing demand for transparent and reliable models, particularly in high-stakes decision-making areas such as medical image analysis, has led to the emergence of eXplainable Artificial Intelligence (XAI). Post-hoc XAI techniques, which aim to explain black-box models after training, have raised concerns about their fidelity to model predictions. In contrast, Self-eXplainable AI (S-XAI) offers a compelling alternative by incorporating explainability directly into the training process of deep learning models. This approach allows models to generate inherent explanations that are closely aligned with their internal decision-making processes, enhancing transparency and supporting the trustworthiness, robustness, and accountability of AI systems in real-world medical applications. To facilitate the development of S-XAI methods for medical image analysis, this survey presents a comprehensive review across various image modalities and clinical applications. It covers more than 200 papers from three key perspectives: 1) input explainability through the integration of explainable feature engineering and knowledge graph, 2) model explainability via attention-based learning, concept-based learning, and prototype-based learning, and 3) output explainability by providing textual and counterfactual explanations. This paper also outlines desired characteristics of explainability and evaluation methods for assessing explanation quality, while discussing major challenges and future research directions in developing S-XAI for medical image analysis.
format Preprint
id arxiv_https___arxiv_org_abs_2410_02331
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Self-eXplainable AI for Medical Image Analysis: A Survey and New Outlooks
Hou, Junlin
Liu, Sicen
Bie, Yequan
Wang, Hongmei
Tan, Andong
Luo, Luyang
Chen, Hao
Computer Vision and Pattern Recognition
The increasing demand for transparent and reliable models, particularly in high-stakes decision-making areas such as medical image analysis, has led to the emergence of eXplainable Artificial Intelligence (XAI). Post-hoc XAI techniques, which aim to explain black-box models after training, have raised concerns about their fidelity to model predictions. In contrast, Self-eXplainable AI (S-XAI) offers a compelling alternative by incorporating explainability directly into the training process of deep learning models. This approach allows models to generate inherent explanations that are closely aligned with their internal decision-making processes, enhancing transparency and supporting the trustworthiness, robustness, and accountability of AI systems in real-world medical applications. To facilitate the development of S-XAI methods for medical image analysis, this survey presents a comprehensive review across various image modalities and clinical applications. It covers more than 200 papers from three key perspectives: 1) input explainability through the integration of explainable feature engineering and knowledge graph, 2) model explainability via attention-based learning, concept-based learning, and prototype-based learning, and 3) output explainability by providing textual and counterfactual explanations. This paper also outlines desired characteristics of explainability and evaluation methods for assessing explanation quality, while discussing major challenges and future research directions in developing S-XAI for medical image analysis.
title Self-eXplainable AI for Medical Image Analysis: A Survey and New Outlooks
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2410.02331