Saved in:
Bibliographic Details
Main Authors: Buck, Alexander, Cosma, Georgina, Phillips, Iain, Conway, Paul, Baker, Patrick
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2601.19017
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914283220107264
author Buck, Alexander
Cosma, Georgina
Phillips, Iain
Conway, Paul
Baker, Patrick
author_facet Buck, Alexander
Cosma, Georgina
Phillips, Iain
Conway, Paul
Baker, Patrick
contents Explainable AI (XAI) is commonly applied to anomalous sound detection (ASD) models to identify which time-frequency regions of an audio signal contribute to an anomaly decision. However, most audio explanations rely on qualitative inspection of saliency maps, leaving open the question of whether these attributions accurately reflect the spectral cues the model uses. In this work, we introduce a new quantitative framework for evaluating XAI faithfulness in machine-sound analysis by directly linking attribution relevance to model behaviour through systematic frequency-band removal. This approach provides an objective measure of whether an XAI method for machine ASD correctly identifies frequency regions that influence an ASD model's predictions. By using four widely adopted methods, namely Integrated Gradients, Occlusion, Grad-CAM and SmoothGrad, we show that XAI techniques differ in reliability, with Occlusion demonstrating the strongest alignment with true model sensitivity and gradient-+based methods often failing to accurately capture spectral dependencies. The proposed framework offers a reproducible way to benchmark audio explanations and enables more trustworthy interpretation of spectrogram-based ASD systems.
format Preprint
id arxiv_https___arxiv_org_abs_2601_19017
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle A Framework for Evaluating Faithfulness in Explainable AI for Machine Anomalous Sound Detection Using Frequency-Band Perturbation
Buck, Alexander
Cosma, Georgina
Phillips, Iain
Conway, Paul
Baker, Patrick
Sound
Machine Learning
Explainable AI (XAI) is commonly applied to anomalous sound detection (ASD) models to identify which time-frequency regions of an audio signal contribute to an anomaly decision. However, most audio explanations rely on qualitative inspection of saliency maps, leaving open the question of whether these attributions accurately reflect the spectral cues the model uses. In this work, we introduce a new quantitative framework for evaluating XAI faithfulness in machine-sound analysis by directly linking attribution relevance to model behaviour through systematic frequency-band removal. This approach provides an objective measure of whether an XAI method for machine ASD correctly identifies frequency regions that influence an ASD model's predictions. By using four widely adopted methods, namely Integrated Gradients, Occlusion, Grad-CAM and SmoothGrad, we show that XAI techniques differ in reliability, with Occlusion demonstrating the strongest alignment with true model sensitivity and gradient-+based methods often failing to accurately capture spectral dependencies. The proposed framework offers a reproducible way to benchmark audio explanations and enables more trustworthy interpretation of spectrogram-based ASD systems.
title A Framework for Evaluating Faithfulness in Explainable AI for Machine Anomalous Sound Detection Using Frequency-Band Perturbation
topic Sound
Machine Learning
url https://arxiv.org/abs/2601.19017