Joint Optimization of Speaker and Spoof Detectors for Spoofing-Robust Automatic Speaker Verification

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kurnaz, Oğuzhan, Mishra, Jagabandhu, Kinnunen, Tomi H., Hanilçi, Cemal
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917367427104768
author Kurnaz, Oğuzhan
Mishra, Jagabandhu
Kinnunen, Tomi H.
Hanilçi, Cemal
author_facet Kurnaz, Oğuzhan
Mishra, Jagabandhu
Kinnunen, Tomi H.
Hanilçi, Cemal
contents Spoofing-robust speaker verification (SASV) combines the tasks of speaker and spoof detection to authenticate speakers under adversarial settings. Many SASV systems rely on fusion of speaker and spoof cues at embedding, score or decision levels, based on independently trained subsystems. In this study, we respect similar modularity of the two subsystems, by integrating their outputs using trainable back-end classifiers. In particular, we explore various approaches for directly optimizing the back-end for the recently-proposed SASV performance metric (a-DCF) as a training objective. Our experiments on the ASVspoof 5 dataset demonstrate two important findings: (i) nonlinear score fusion consistently improves a-DCF over linear fusion, and (ii) the combination of weighted cosine scoring for speaker detection with SSL-AASIST for spoof detection achieves state-of-the-art performance, reducing min a-DCF to 0.196 and SPF-EER to 7.6%. These contributions highlight the importance of modular design, calibrated integration, and task-aligned optimization for advancing robust and interpretable SASV systems.
format Preprint
id arxiv_https___arxiv_org_abs_2510_01818
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Joint Optimization of Speaker and Spoof Detectors for Spoofing-Robust Automatic Speaker Verification
Kurnaz, Oğuzhan
Mishra, Jagabandhu
Kinnunen, Tomi H.
Hanilçi, Cemal
Audio and Speech Processing
Spoofing-robust speaker verification (SASV) combines the tasks of speaker and spoof detection to authenticate speakers under adversarial settings. Many SASV systems rely on fusion of speaker and spoof cues at embedding, score or decision levels, based on independently trained subsystems. In this study, we respect similar modularity of the two subsystems, by integrating their outputs using trainable back-end classifiers. In particular, we explore various approaches for directly optimizing the back-end for the recently-proposed SASV performance metric (a-DCF) as a training objective. Our experiments on the ASVspoof 5 dataset demonstrate two important findings: (i) nonlinear score fusion consistently improves a-DCF over linear fusion, and (ii) the combination of weighted cosine scoring for speaker detection with SSL-AASIST for spoof detection achieves state-of-the-art performance, reducing min a-DCF to 0.196 and SPF-EER to 7.6%. These contributions highlight the importance of modular design, calibrated integration, and task-aligned optimization for advancing robust and interpretable SASV systems.
title Joint Optimization of Speaker and Spoof Detectors for Spoofing-Robust Automatic Speaker Verification
topic Audio and Speech Processing
url https://arxiv.org/abs/2510.01818