Speech Quality-Based Localization of Low-Quality Speech and Text-to-Speech Synthesis Artefacts
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866915761260331008 |
|---|---|
| author | Kuhlmann, Michael Werning, Alexander von Neumann, Thilo Haeb-Umbach, Reinhold |
| author_facet | Kuhlmann, Michael Werning, Alexander von Neumann, Thilo Haeb-Umbach, Reinhold |
| contents | A large number of works view the automatic assessment of speech from an utterance- or system-level perspective. While such approaches are good in judging overall quality, they cannot adequately explain why a certain score was assigned to an utterance. frame-level scores can provide better interpretability, but models predicting them are harder to tune and regularize since no strong targets are available during training. In this work, we show that utterance-level speech quality predictors can be regularized with a segment-based consistency constraint which notably reduces frame-level stochasticity. We then demonstrate two applications involving frame-level scores: The partial spoof scenario and the detection of synthesis artefacts in two state-of-the-art text-to-speech systems. For the latter, we perform listening tests and confirm that listeners rate segments to be of poor quality more often in the set defined by low frame-level scores than in a random control set. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_21886 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Speech Quality-Based Localization of Low-Quality Speech and Text-to-Speech Synthesis Artefacts Kuhlmann, Michael Werning, Alexander von Neumann, Thilo Haeb-Umbach, Reinhold Audio and Speech Processing A large number of works view the automatic assessment of speech from an utterance- or system-level perspective. While such approaches are good in judging overall quality, they cannot adequately explain why a certain score was assigned to an utterance. frame-level scores can provide better interpretability, but models predicting them are harder to tune and regularize since no strong targets are available during training. In this work, we show that utterance-level speech quality predictors can be regularized with a segment-based consistency constraint which notably reduces frame-level stochasticity. We then demonstrate two applications involving frame-level scores: The partial spoof scenario and the detection of synthesis artefacts in two state-of-the-art text-to-speech systems. For the latter, we perform listening tests and confirm that listeners rate segments to be of poor quality more often in the set defined by low frame-level scores than in a random control set. |
| title | Speech Quality-Based Localization of Low-Quality Speech and Text-to-Speech Synthesis Artefacts |
| topic | Audio and Speech Processing |
| url | https://arxiv.org/abs/2601.21886 |