Forensic deepfake audio detection using segmental speech features

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Yang, Tianle, Sun, Chengzhe, Lyu, Siwei, Rose, Phil
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866918242771009536
author Yang, Tianle
Sun, Chengzhe
Lyu, Siwei
Rose, Phil
author_facet Yang, Tianle
Sun, Chengzhe
Lyu, Siwei
Rose, Phil
contents This study explores the potential of using acoustic features of segmental speech sounds to detect deepfake audio. These features are highly interpretable because of their close relationship with human articulatory processes and are expected to be more difficult for deepfake models to replicate. The results demonstrate that certain segmental features commonly used in forensic voice comparison (FVC) are effective in identifying deep-fakes, whereas some global features provide little value. These findings underscore the need to approach audio deepfake detection using methods that are distinct from those employed in traditional FVC, and offer a new perspective on leveraging segmental features for this purpose. In addition, the present study proposes a speaker-specific framework for deepfake detection, which differs fundamentally from the speaker-independent systems that dominate current benchmarks. While speaker-independent frameworks aim at broad generalization, the speaker-specific approach offers advantages in forensic contexts where case-by-case interpretability and sensitivity to individual phonetic realization are essential.
format Preprint
id arxiv_https___arxiv_org_abs_2505_13847
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Forensic deepfake audio detection using segmental speech features
Yang, Tianle
Sun, Chengzhe
Lyu, Siwei
Rose, Phil
Sound
Artificial Intelligence
Computation and Language
Audio and Speech Processing
This study explores the potential of using acoustic features of segmental speech sounds to detect deepfake audio. These features are highly interpretable because of their close relationship with human articulatory processes and are expected to be more difficult for deepfake models to replicate. The results demonstrate that certain segmental features commonly used in forensic voice comparison (FVC) are effective in identifying deep-fakes, whereas some global features provide little value. These findings underscore the need to approach audio deepfake detection using methods that are distinct from those employed in traditional FVC, and offer a new perspective on leveraging segmental features for this purpose. In addition, the present study proposes a speaker-specific framework for deepfake detection, which differs fundamentally from the speaker-independent systems that dominate current benchmarks. While speaker-independent frameworks aim at broad generalization, the speaker-specific approach offers advantages in forensic contexts where case-by-case interpretability and sensitivity to individual phonetic realization are essential.
title Forensic deepfake audio detection using segmental speech features
topic Sound
Artificial Intelligence
Computation and Language
Audio and Speech Processing
url https://arxiv.org/abs/2505.13847