I Guess That's Why They Call it the Blues: Causal Analysis for Audio Classifiers

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Kelly, David A., Chockler, Hana
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909998939897856
author Kelly, David A.
Chockler, Hana
author_facet Kelly, David A.
Chockler, Hana
contents It is well-known that audio classifiers often rely on non-musically relevant features and spurious correlations to classify audio. Hence audio classifiers are easy to manipulate or confuse, resulting in wrong classifications. While inducing a misclassification is not hard, until now the set of features that the classifiers rely on was not well understood. In this paper we introduce a new method that uses causal reasoning to discover features of the frequency space that are sufficient and necessary for a given classification. We describe an implementation of this algorithm in the tool FreqReX and provide experimental results on a number of standard benchmark datasets. Our experiments show that causally sufficient and necessary subsets allow us to manipulate the outputs of the models in a variety of ways by changing the input very slightly. Namely, a change to one out of 240,000 frequencies results in a change in classification 58% of the time, and the change can be so small that it is practically inaudible. These results show that causal analysis is useful for understanding the reasoning process of audio classifiers and can be used to successfully manipulate their outputs.
format Preprint
id arxiv_https___arxiv_org_abs_2601_16675
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle I Guess That's Why They Call it the Blues: Causal Analysis for Audio Classifiers
Kelly, David A.
Chockler, Hana
Sound
Machine Learning
Audio and Speech Processing
It is well-known that audio classifiers often rely on non-musically relevant features and spurious correlations to classify audio. Hence audio classifiers are easy to manipulate or confuse, resulting in wrong classifications. While inducing a misclassification is not hard, until now the set of features that the classifiers rely on was not well understood. In this paper we introduce a new method that uses causal reasoning to discover features of the frequency space that are sufficient and necessary for a given classification. We describe an implementation of this algorithm in the tool FreqReX and provide experimental results on a number of standard benchmark datasets. Our experiments show that causally sufficient and necessary subsets allow us to manipulate the outputs of the models in a variety of ways by changing the input very slightly. Namely, a change to one out of 240,000 frequencies results in a change in classification 58% of the time, and the change can be so small that it is practically inaudible. These results show that causal analysis is useful for understanding the reasoning process of audio classifiers and can be used to successfully manipulate their outputs.
title I Guess That's Why They Call it the Blues: Causal Analysis for Audio Classifiers
topic Sound
Machine Learning
Audio and Speech Processing
url https://arxiv.org/abs/2601.16675