XPPG-PCA: Reference-free automatic speech severity evaluation with principal components

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Halpern, Bence Mark, Tienkamp, Thomas B., Rebernik, Teja, van Son, Rob J. J. H., de Visscher, Sebastiaan A. H. J., Witjes, Max J. H., Abur, Defne, Toda, Tomoki
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915844419747840
author Halpern, Bence Mark
Tienkamp, Thomas B.
Rebernik, Teja
van Son, Rob J. J. H.
de Visscher, Sebastiaan A. H. J.
Witjes, Max J. H.
Abur, Defne
Toda, Tomoki
author_facet Halpern, Bence Mark
Tienkamp, Thomas B.
Rebernik, Teja
van Son, Rob J. J. H.
de Visscher, Sebastiaan A. H. J.
Witjes, Max J. H.
Abur, Defne
Toda, Tomoki
contents Reliably evaluating the severity of a speech pathology is crucial in healthcare. However, the current reliance on expert evaluations by speech-language pathologists presents several challenges: while their assessments are highly skilled, they are also subjective, time-consuming, and costly, which can limit the reproducibility of clinical studies and place a strain on healthcare resources. While automated methods exist, they have significant drawbacks. Reference-based approaches require transcriptions or healthy speech samples, restricting them to read speech and limiting their applicability. Existing reference-free methods are also flawed; supervised models often learn spurious shortcuts from data, while handcrafted features are often unreliable and restricted to specific speech tasks. This paper introduces XPPG-PCA (x-vector phonetic posteriorgram principal component analysis), a novel, unsupervised, reference-free method for speech severity evaluation. Using three Dutch oral cancer datasets, we demonstrate that XPPG-PCA performs comparably to, or exceeds established reference-based methods. Our experiments confirm its robustness against data shortcuts and noise, showing its potential for real-world clinical use. Taken together, our results show that XPPG-PCA provides a robust, generalizable solution for the objective assessment of speech pathology, with the potential to significantly improve the efficiency and reliability of clinical evaluations across a range of disorders. An open-source implementation is available.
format Preprint
id arxiv_https___arxiv_org_abs_2510_00657
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle XPPG-PCA: Reference-free automatic speech severity evaluation with principal components
Halpern, Bence Mark
Tienkamp, Thomas B.
Rebernik, Teja
van Son, Rob J. J. H.
de Visscher, Sebastiaan A. H. J.
Witjes, Max J. H.
Abur, Defne
Toda, Tomoki
Sound
Reliably evaluating the severity of a speech pathology is crucial in healthcare. However, the current reliance on expert evaluations by speech-language pathologists presents several challenges: while their assessments are highly skilled, they are also subjective, time-consuming, and costly, which can limit the reproducibility of clinical studies and place a strain on healthcare resources. While automated methods exist, they have significant drawbacks. Reference-based approaches require transcriptions or healthy speech samples, restricting them to read speech and limiting their applicability. Existing reference-free methods are also flawed; supervised models often learn spurious shortcuts from data, while handcrafted features are often unreliable and restricted to specific speech tasks. This paper introduces XPPG-PCA (x-vector phonetic posteriorgram principal component analysis), a novel, unsupervised, reference-free method for speech severity evaluation. Using three Dutch oral cancer datasets, we demonstrate that XPPG-PCA performs comparably to, or exceeds established reference-based methods. Our experiments confirm its robustness against data shortcuts and noise, showing its potential for real-world clinical use. Taken together, our results show that XPPG-PCA provides a robust, generalizable solution for the objective assessment of speech pathology, with the potential to significantly improve the efficiency and reliability of clinical evaluations across a range of disorders. An open-source implementation is available.
title XPPG-PCA: Reference-free automatic speech severity evaluation with principal components
topic Sound
url https://arxiv.org/abs/2510.00657