QAMO: Quality-aware Multi-centroid One-class Learning For Speech Deepfake Detection

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Truong, Duc-Tuan, Liu, Tianchi, Tao, Ruijie, Li, Junjie, Lee, Kong Aik, Chng, Eng Siong
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916969486221312
author Truong, Duc-Tuan
Liu, Tianchi
Tao, Ruijie
Li, Junjie
Lee, Kong Aik
Chng, Eng Siong
author_facet Truong, Duc-Tuan
Liu, Tianchi
Tao, Ruijie
Li, Junjie
Lee, Kong Aik
Chng, Eng Siong
contents Recent work shows that one-class learning can detect unseen deepfake attacks by modeling a compact distribution of bona fide speech around a single centroid. However, the single-centroid assumption can oversimplify the bona fide speech representation and overlook useful cues, such as speech quality, which reflects the naturalness of the speech. Speech quality can be easily obtained using existing speech quality assessment models that estimate it through Mean Opinion Score. In this paper, we propose QAMO: Quality-Aware Multi-Centroid One-Class Learning for speech deepfake detection. QAMO extends conventional one-class learning by introducing multiple quality-aware centroids. In QAMO, each centroid is optimized to represent a distinct speech quality subspaces, enabling better modeling of intra-class variability in bona fide speech. In addition, QAMO supports a multi-centroid ensemble scoring strategy, which improves decision thresholding and reduces the need for quality labels during inference. With two centroids to represent high- and low-quality speech, our proposed QAMO achieves an equal error rate of 5.09% in In-the-Wild dataset, outperforming previous one-class and quality-aware systems.
format Preprint
id arxiv_https___arxiv_org_abs_2509_20679
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle QAMO: Quality-aware Multi-centroid One-class Learning For Speech Deepfake Detection
Truong, Duc-Tuan
Liu, Tianchi
Tao, Ruijie
Li, Junjie
Lee, Kong Aik
Chng, Eng Siong
Sound
Artificial Intelligence
Recent work shows that one-class learning can detect unseen deepfake attacks by modeling a compact distribution of bona fide speech around a single centroid. However, the single-centroid assumption can oversimplify the bona fide speech representation and overlook useful cues, such as speech quality, which reflects the naturalness of the speech. Speech quality can be easily obtained using existing speech quality assessment models that estimate it through Mean Opinion Score. In this paper, we propose QAMO: Quality-Aware Multi-Centroid One-Class Learning for speech deepfake detection. QAMO extends conventional one-class learning by introducing multiple quality-aware centroids. In QAMO, each centroid is optimized to represent a distinct speech quality subspaces, enabling better modeling of intra-class variability in bona fide speech. In addition, QAMO supports a multi-centroid ensemble scoring strategy, which improves decision thresholding and reduces the need for quality labels during inference. With two centroids to represent high- and low-quality speech, our proposed QAMO achieves an equal error rate of 5.09% in In-the-Wild dataset, outperforming previous one-class and quality-aware systems.
title QAMO: Quality-aware Multi-centroid One-class Learning For Speech Deepfake Detection
topic Sound
Artificial Intelligence
url https://arxiv.org/abs/2509.20679