Analyzing the Impact of Splicing Artifacts in Partially Fake Speech Signals

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Negroni, Viola, Salvi, Davide, Bestagini, Paolo, Tubaro, Stefano
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909295214329856
author Negroni, Viola
Salvi, Davide
Bestagini, Paolo
Tubaro, Stefano
author_facet Negroni, Viola
Salvi, Davide
Bestagini, Paolo
Tubaro, Stefano
contents Speech deepfake detection has recently gained significant attention within the multimedia forensics community. Related issues have also been explored, such as the identification of partially fake signals, i.e., tracks that include both real and fake speech segments. However, generating high-quality spliced audio is not as straightforward as it may appear. Spliced signals are typically created through basic signal concatenation. This process could introduce noticeable artifacts that can make the generated data easier to detect. We analyze spliced audio tracks resulting from signal concatenation, investigate their artifacts and assess whether such artifacts introduce any bias in existing datasets. Our findings reveal that by analyzing splicing artifacts, we can achieve a detection EER of 6.16% and 7.36% on PartialSpoof and HAD datasets, respectively, without needing to train any detector. These results underscore the complexities of generating reliable spliced audio data and lead to discussions that can help improve future research in this area.
format Preprint
id arxiv_https___arxiv_org_abs_2408_13784
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Analyzing the Impact of Splicing Artifacts in Partially Fake Speech Signals
Negroni, Viola
Salvi, Davide
Bestagini, Paolo
Tubaro, Stefano
Sound
Artificial Intelligence
Multimedia
Audio and Speech Processing
Speech deepfake detection has recently gained significant attention within the multimedia forensics community. Related issues have also been explored, such as the identification of partially fake signals, i.e., tracks that include both real and fake speech segments. However, generating high-quality spliced audio is not as straightforward as it may appear. Spliced signals are typically created through basic signal concatenation. This process could introduce noticeable artifacts that can make the generated data easier to detect. We analyze spliced audio tracks resulting from signal concatenation, investigate their artifacts and assess whether such artifacts introduce any bias in existing datasets. Our findings reveal that by analyzing splicing artifacts, we can achieve a detection EER of 6.16% and 7.36% on PartialSpoof and HAD datasets, respectively, without needing to train any detector. These results underscore the complexities of generating reliable spliced audio data and lead to discussions that can help improve future research in this area.
title Analyzing the Impact of Splicing Artifacts in Partially Fake Speech Signals
topic Sound
Artificial Intelligence
Multimedia
Audio and Speech Processing
url https://arxiv.org/abs/2408.13784