Quantifying the effect of speech pathology on automatic and human speaker verification
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909220306157568 |
|---|---|
| author | Halpern, Bence Mark Tienkamp, Thomas Huang, Wen-Chin Violeta, Lester Phillip Rebernik, Teja de Visscher, Sebastiaan Witjes, Max Wieling, Martijn Abur, Defne Toda, Tomoki |
| author_facet | Halpern, Bence Mark Tienkamp, Thomas Huang, Wen-Chin Violeta, Lester Phillip Rebernik, Teja de Visscher, Sebastiaan Witjes, Max Wieling, Martijn Abur, Defne Toda, Tomoki |
| contents | This study investigates how surgical intervention for speech pathology (specifically, as a result of oral cancer surgery) impacts the performance of an automatic speaker verification (ASV) system. Using two recently collected Dutch datasets with parallel pre and post-surgery audio from the same speaker, NKI-OC-VC and SPOKE, we assess the extent to which speech pathology influences ASV performance, and whether objective/subjective measures of speech severity are correlated with the performance. Finally, we carry out a perceptual study to compare judgements of ASV and human listeners. Our findings reveal that pathological speech negatively affects ASV performance, and the severity of the speech is negatively correlated with the performance. There is a moderate agreement in perceptual and objective scores of speaker similarity and severity, however, we could not clearly establish in the perceptual study, whether the same phenomenon also exists in human perception. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_06208 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Quantifying the effect of speech pathology on automatic and human speaker verification Halpern, Bence Mark Tienkamp, Thomas Huang, Wen-Chin Violeta, Lester Phillip Rebernik, Teja de Visscher, Sebastiaan Witjes, Max Wieling, Martijn Abur, Defne Toda, Tomoki Sound Audio and Speech Processing I.2.7 This study investigates how surgical intervention for speech pathology (specifically, as a result of oral cancer surgery) impacts the performance of an automatic speaker verification (ASV) system. Using two recently collected Dutch datasets with parallel pre and post-surgery audio from the same speaker, NKI-OC-VC and SPOKE, we assess the extent to which speech pathology influences ASV performance, and whether objective/subjective measures of speech severity are correlated with the performance. Finally, we carry out a perceptual study to compare judgements of ASV and human listeners. Our findings reveal that pathological speech negatively affects ASV performance, and the severity of the speech is negatively correlated with the performance. There is a moderate agreement in perceptual and objective scores of speaker similarity and severity, however, we could not clearly establish in the perceptual study, whether the same phenomenon also exists in human perception. |
| title | Quantifying the effect of speech pathology on automatic and human speaker verification |
| topic | Sound Audio and Speech Processing I.2.7 |
| url | https://arxiv.org/abs/2406.06208 |