Saved in:
Bibliographic Details
Main Authors: Kaufman, Eran, levy, Avivit
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2411.16895
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915034018349056
author Kaufman, Eran
levy, Avivit
author_facet Kaufman, Eran
levy, Avivit
contents This paper introduces a novel XAI approach based on near-misses analysis (NMA). This approach reveals a hierarchy of logical 'concepts' inferred from the latent decision-making process of a Neural Network (NN) without delving into its explicit structure. We examined our proposed XAI approach on different network architectures that vary in size and shape (e.g., ResNet, VGG, EfficientNet, MobileNet) on several datasets (ImageNet and CIFAR100). The results demonstrate its usability to reflect NNs latent process of concepts generation. We generated a new metric for explainability. Moreover, our experiments suggest that efficient architectures, which achieve a similar accuracy level with much less neurons may still pay the price of explainability and robustness in terms of concepts generation. We, thus, pave a promising new path for XAI research to follow.
format Preprint
id arxiv_https___arxiv_org_abs_2411_16895
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Explainable AI Approach using Near Misses Analysis
Kaufman, Eran
levy, Avivit
Machine Learning
This paper introduces a novel XAI approach based on near-misses analysis (NMA). This approach reveals a hierarchy of logical 'concepts' inferred from the latent decision-making process of a Neural Network (NN) without delving into its explicit structure. We examined our proposed XAI approach on different network architectures that vary in size and shape (e.g., ResNet, VGG, EfficientNet, MobileNet) on several datasets (ImageNet and CIFAR100). The results demonstrate its usability to reflect NNs latent process of concepts generation. We generated a new metric for explainability. Moreover, our experiments suggest that efficient architectures, which achieve a similar accuracy level with much less neurons may still pay the price of explainability and robustness in terms of concepts generation. We, thus, pave a promising new path for XAI research to follow.
title Explainable AI Approach using Near Misses Analysis
topic Machine Learning
url https://arxiv.org/abs/2411.16895