Towards explainable reference-free speech intelligibility evaluation of people with pathological speech

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Halpern, Bence Mark, Tienkamp, Thomas, Abur, Defne, Toda, Tomoki
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908835189358592
author Halpern, Bence Mark
Tienkamp, Thomas
Abur, Defne
Toda, Tomoki
author_facet Halpern, Bence Mark
Tienkamp, Thomas
Abur, Defne
Toda, Tomoki
contents Objective assessment of speech that reflects meaningful changes in communication is crucial for clinical decision making and reproducible research. While existing objective assessments, particularly reference-based approaches, can capture intelligibility changes, they are often hindered by lack of explainability and the need for labor-intensive manual transcriptions. To address these issues, this work proposes the reference-free, explainable ASR Inconsistency Score. We evaluate this method on pathological speech in Dutch, Spanish and English, and compare its performance to a reference-based Word Error Rate (WER) baseline. Our results demonstrate that the ASR Inconsistency Score achieves a high correlation with expert perceptual ratings, with performance closely matching, and in one case exceeding, a standard reference-based Word Error Rate (WER) baseline.
format Preprint
id arxiv_https___arxiv_org_abs_2602_12723
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Towards explainable reference-free speech intelligibility evaluation of people with pathological speech
Halpern, Bence Mark
Tienkamp, Thomas
Abur, Defne
Toda, Tomoki
Sound
Objective assessment of speech that reflects meaningful changes in communication is crucial for clinical decision making and reproducible research. While existing objective assessments, particularly reference-based approaches, can capture intelligibility changes, they are often hindered by lack of explainability and the need for labor-intensive manual transcriptions. To address these issues, this work proposes the reference-free, explainable ASR Inconsistency Score. We evaluate this method on pathological speech in Dutch, Spanish and English, and compare its performance to a reference-based Word Error Rate (WER) baseline. Our results demonstrate that the ASR Inconsistency Score achieves a high correlation with expert perceptual ratings, with performance closely matching, and in one case exceeding, a standard reference-based Word Error Rate (WER) baseline.
title Towards explainable reference-free speech intelligibility evaluation of people with pathological speech
topic Sound
url https://arxiv.org/abs/2602.12723