Interpretable Medical Image Classification using Prototype Learning and Privileged Information

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Gallee, Luisa, Beer, Meinrad, Goetz, Michael
Format: Preprint
Veröffentlicht: 2023
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910030445412352
author Gallee, Luisa
Beer, Meinrad
Goetz, Michael
author_facet Gallee, Luisa
Beer, Meinrad
Goetz, Michael
contents Interpretability is often an essential requirement in medical imaging. Advanced deep learning methods are required to address this need for explainability and high performance. In this work, we investigate whether additional information available during the training process can be used to create an understandable and powerful model. We propose an innovative solution called Proto-Caps that leverages the benefits of capsule networks, prototype learning and the use of privileged information. Evaluating the proposed solution on the LIDC-IDRI dataset shows that it combines increased interpretability with above state-of-the-art prediction performance. Compared to the explainable baseline model, our method achieves more than 6 % higher accuracy in predicting both malignancy (93.0 %) and mean characteristic features of lung nodules. Simultaneously, the model provides case-based reasoning with prototype representations that allow visual validation of radiologist-defined attributes.
format Preprint
id arxiv_https___arxiv_org_abs_2310_15741
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Interpretable Medical Image Classification using Prototype Learning and Privileged Information
Gallee, Luisa
Beer, Meinrad
Goetz, Michael
Computer Vision and Pattern Recognition
Artificial Intelligence
Interpretability is often an essential requirement in medical imaging. Advanced deep learning methods are required to address this need for explainability and high performance. In this work, we investigate whether additional information available during the training process can be used to create an understandable and powerful model. We propose an innovative solution called Proto-Caps that leverages the benefits of capsule networks, prototype learning and the use of privileged information. Evaluating the proposed solution on the LIDC-IDRI dataset shows that it combines increased interpretability with above state-of-the-art prediction performance. Compared to the explainable baseline model, our method achieves more than 6 % higher accuracy in predicting both malignancy (93.0 %) and mean characteristic features of lung nodules. Simultaneously, the model provides case-based reasoning with prototype representations that allow visual validation of radiologist-defined attributes.
title Interpretable Medical Image Classification using Prototype Learning and Privileged Information
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2310.15741