Fast and Accurate Explanations of Distance-Based Classifiers by Uncovering Latent Explanatory Structures

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Bley, Florian, Kauffmann, Jacob, Krug, Simon León, Müller, Klaus-Robert, Montavon, Grégoire
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914527912656896
author Bley, Florian
Kauffmann, Jacob
Krug, Simon León
Müller, Klaus-Robert
Montavon, Grégoire
author_facet Bley, Florian
Kauffmann, Jacob
Krug, Simon León
Müller, Klaus-Robert
Montavon, Grégoire
contents Distance-based classifiers, such as k-nearest neighbors and support vector machines, continue to be a workhorse of machine learning, widely used in science and industry. In practice, to derive insights from these models, it is also important to ensure that their predictions are explainable. While the field of Explainable AI has supplied methods that are in principle applicable to any model, it has also emphasized the usefulness of latent structures (e.g. the sequence of layers in a neural network) to produce explanations. In this paper, we contribute by uncovering a hidden neural network structure in distance-based classifiers (consisting of linear detection units combined with nonlinear pooling layers) upon which Explainable AI techniques such as layer-wise relevance propagation (LRP) become applicable. Through quantitative evaluations, we demonstrate the advantage of our novel explanation approach over several baselines. We also show the overall usefulness of explaining distance-based models through two practical use cases.
format Preprint
id arxiv_https___arxiv_org_abs_2508_03913
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Fast and Accurate Explanations of Distance-Based Classifiers by Uncovering Latent Explanatory Structures
Bley, Florian
Kauffmann, Jacob
Krug, Simon León
Müller, Klaus-Robert
Montavon, Grégoire
Machine Learning
Artificial Intelligence
Distance-based classifiers, such as k-nearest neighbors and support vector machines, continue to be a workhorse of machine learning, widely used in science and industry. In practice, to derive insights from these models, it is also important to ensure that their predictions are explainable. While the field of Explainable AI has supplied methods that are in principle applicable to any model, it has also emphasized the usefulness of latent structures (e.g. the sequence of layers in a neural network) to produce explanations. In this paper, we contribute by uncovering a hidden neural network structure in distance-based classifiers (consisting of linear detection units combined with nonlinear pooling layers) upon which Explainable AI techniques such as layer-wise relevance propagation (LRP) become applicable. Through quantitative evaluations, we demonstrate the advantage of our novel explanation approach over several baselines. We also show the overall usefulness of explaining distance-based models through two practical use cases.
title Fast and Accurate Explanations of Distance-Based Classifiers by Uncovering Latent Explanatory Structures
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2508.03913