Pitfalls and Limits in Automatic Dementia Assessment
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866911094683992064 |
|---|---|
| author | Braun, Franziska Witzl, Christopher Erzigkeit, Andreas Lehfeld, Hartmut Hillemacher, Thomas Bocklet, Tobias Riedhammer, Korbinian |
| author_facet | Braun, Franziska Witzl, Christopher Erzigkeit, Andreas Lehfeld, Hartmut Hillemacher, Thomas Bocklet, Tobias Riedhammer, Korbinian |
| contents | Current work on speech-based dementia assessment focuses on either feature extraction to predict assessment scales, or on the automation of existing test procedures. Most research uses public data unquestioningly and rarely performs a detailed error analysis, focusing primarily on numerical performance. We perform an in-depth analysis of an automated standardized dementia assessment, the Syndrom-Kurz-Test. We find that while there is a high overall correlation with human annotators, due to certain artifacts, we observe high correlations for the severely impaired individuals, which is less true for the healthy or mildly impaired ones. Speech production decreases with cognitive decline, leading to overoptimistic correlations when test scoring relies on word naming. Depending on the test design, fallback handling introduces further biases that favor certain groups. These pitfalls remain independent of group distributions in datasets and require differentiated analysis of target groups. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_04512 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Pitfalls and Limits in Automatic Dementia Assessment Braun, Franziska Witzl, Christopher Erzigkeit, Andreas Lehfeld, Hartmut Hillemacher, Thomas Bocklet, Tobias Riedhammer, Korbinian Audio and Speech Processing Current work on speech-based dementia assessment focuses on either feature extraction to predict assessment scales, or on the automation of existing test procedures. Most research uses public data unquestioningly and rarely performs a detailed error analysis, focusing primarily on numerical performance. We perform an in-depth analysis of an automated standardized dementia assessment, the Syndrom-Kurz-Test. We find that while there is a high overall correlation with human annotators, due to certain artifacts, we observe high correlations for the severely impaired individuals, which is less true for the healthy or mildly impaired ones. Speech production decreases with cognitive decline, leading to overoptimistic correlations when test scoring relies on word naming. Depending on the test design, fallback handling introduces further biases that favor certain groups. These pitfalls remain independent of group distributions in datasets and require differentiated analysis of target groups. |
| title | Pitfalls and Limits in Automatic Dementia Assessment |
| topic | Audio and Speech Processing |
| url | https://arxiv.org/abs/2508.04512 |