Naturalness-Aware Curriculum Learning with Dynamic Temperature for Speech Deepfake Detection

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Kim, Taewoo, Kim, Guisik, Cho, Choongsang, Lee, Young Han
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915293710778368
author Kim, Taewoo
Kim, Guisik
Cho, Choongsang
Lee, Young Han
author_facet Kim, Taewoo
Kim, Guisik
Cho, Choongsang
Lee, Young Han
contents Recent advances in speech deepfake detection (SDD) have significantly improved artifacts-based detection in spoofed speech. However, most models overlook speech naturalness, a crucial cue for distinguishing bona fide speech from spoofed speech. This study proposes naturalness-aware curriculum learning, a novel training framework that leverages speech naturalness to enhance the robustness and generalization of SDD. This approach measures sample difficulty using both ground-truth labels and mean opinion scores, and adjusts the training schedule to progressively introduce more challenging samples. To further improve generalization, a dynamic temperature scaling method based on speech naturalness is incorporated into the training process. A 23% relative reduction in the EER was achieved in the experiments on the ASVspoof 2021 DF dataset, without modifying the model architecture. Ablation studies confirmed the effectiveness of naturalness-aware training strategies for SDD tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2505_13976
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Naturalness-Aware Curriculum Learning with Dynamic Temperature for Speech Deepfake Detection
Kim, Taewoo
Kim, Guisik
Cho, Choongsang
Lee, Young Han
Audio and Speech Processing
Sound
Recent advances in speech deepfake detection (SDD) have significantly improved artifacts-based detection in spoofed speech. However, most models overlook speech naturalness, a crucial cue for distinguishing bona fide speech from spoofed speech. This study proposes naturalness-aware curriculum learning, a novel training framework that leverages speech naturalness to enhance the robustness and generalization of SDD. This approach measures sample difficulty using both ground-truth labels and mean opinion scores, and adjusts the training schedule to progressively introduce more challenging samples. To further improve generalization, a dynamic temperature scaling method based on speech naturalness is incorporated into the training process. A 23% relative reduction in the EER was achieved in the experiments on the ASVspoof 2021 DF dataset, without modifying the model architecture. Ablation studies confirmed the effectiveness of naturalness-aware training strategies for SDD tasks.
title Naturalness-Aware Curriculum Learning with Dynamic Temperature for Speech Deepfake Detection
topic Audio and Speech Processing
Sound
url https://arxiv.org/abs/2505.13976