Explainable Image Classification with Reduced Overconfidence for Tissue Characterisation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Roddan, Alfie, Xu, Chi, Ajlouni, Serine, Kakaletri, Irini, Charalampaki, Patra, Giannarou, Stamatia
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912513430388736
author Roddan, Alfie
Xu, Chi
Ajlouni, Serine
Kakaletri, Irini
Charalampaki, Patra
Giannarou, Stamatia
author_facet Roddan, Alfie
Xu, Chi
Ajlouni, Serine
Kakaletri, Irini
Charalampaki, Patra
Giannarou, Stamatia
contents The deployment of Machine Learning models intraoperatively for tissue characterisation can assist decision making and guide safe tumour resections. For image classification models, pixel attribution methods are popular to infer explainability. However, overconfidence in deep learning model's predictions translates to overconfidence in pixel attribution. In this paper, we propose the first approach which incorporates risk estimation into a pixel attribution method for improved image classification explainability. The proposed method iteratively applies a classification model with a pixel attribution method to create a volume of PA maps. This volume is used for the first time, to generate a pixel-wise distribution of PA values. We introduce a method to generate an enhanced PA map by estimating the expectation values of the pixel-wise distributions. In addition, the coefficient of variation (CV) is used to estimate pixel-wise risk of this enhanced PA map. Hence, the proposed method not only provides an improved PA map but also produces an estimation of risk on the output PA values. Performance evaluation on probe-based Confocal Laser Endomicroscopy (pCLE) data and ImageNet verifies that our improved explainability method outperforms the state-of-the-art.
format Preprint
id arxiv_https___arxiv_org_abs_2507_23709
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Explainable Image Classification with Reduced Overconfidence for Tissue Characterisation
Roddan, Alfie
Xu, Chi
Ajlouni, Serine
Kakaletri, Irini
Charalampaki, Patra
Giannarou, Stamatia
Computer Vision and Pattern Recognition
The deployment of Machine Learning models intraoperatively for tissue characterisation can assist decision making and guide safe tumour resections. For image classification models, pixel attribution methods are popular to infer explainability. However, overconfidence in deep learning model's predictions translates to overconfidence in pixel attribution. In this paper, we propose the first approach which incorporates risk estimation into a pixel attribution method for improved image classification explainability. The proposed method iteratively applies a classification model with a pixel attribution method to create a volume of PA maps. This volume is used for the first time, to generate a pixel-wise distribution of PA values. We introduce a method to generate an enhanced PA map by estimating the expectation values of the pixel-wise distributions. In addition, the coefficient of variation (CV) is used to estimate pixel-wise risk of this enhanced PA map. Hence, the proposed method not only provides an improved PA map but also produces an estimation of risk on the output PA values. Performance evaluation on probe-based Confocal Laser Endomicroscopy (pCLE) data and ImageNet verifies that our improved explainability method outperforms the state-of-the-art.
title Explainable Image Classification with Reduced Overconfidence for Tissue Characterisation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.23709