Saved in:
Bibliographic Details
Main Authors: Vidal, Jazmín, Ferrer, Luciana
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2605.23593
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916039546109952
author Vidal, Jazmín
Ferrer, Luciana
author_facet Vidal, Jazmín
Ferrer, Luciana
contents Phoneme-level computer-assisted pronunciation training systems typically rely on phoneme-level annotations, which are costly and scarce. In this work, we investigate whether phoneme-level mispronunciation information can be learned without phoneme-level supervision by exploiting higher-level pronunciation labels. Specifically, we study a weakly supervised setting in which models are trained using only utterance- or word-level pronunciation labels and analyze whether this supervision induces useful phoneme-level score predictions. We further consider a two-stage training scenario in which a model trained only with utterance-level labels is finetuned using a limited number of carefully-selected phoneme-level labeled utterances. We find that, using our proposed architecture and selection process, the two-stage process leads to comparable results to those obtained with full phoneme-level supervision, requiring only a small fraction of phoneme-level labels.
format Preprint
id arxiv_https___arxiv_org_abs_2605_23593
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle A study on weakly-supervised training approaches for phoneme-level pronunciation scoring
Vidal, Jazmín
Ferrer, Luciana
Audio and Speech Processing
Phoneme-level computer-assisted pronunciation training systems typically rely on phoneme-level annotations, which are costly and scarce. In this work, we investigate whether phoneme-level mispronunciation information can be learned without phoneme-level supervision by exploiting higher-level pronunciation labels. Specifically, we study a weakly supervised setting in which models are trained using only utterance- or word-level pronunciation labels and analyze whether this supervision induces useful phoneme-level score predictions. We further consider a two-stage training scenario in which a model trained only with utterance-level labels is finetuned using a limited number of carefully-selected phoneme-level labeled utterances. We find that, using our proposed architecture and selection process, the two-stage process leads to comparable results to those obtained with full phoneme-level supervision, requiring only a small fraction of phoneme-level labels.
title A study on weakly-supervised training approaches for phoneme-level pronunciation scoring
topic Audio and Speech Processing
url https://arxiv.org/abs/2605.23593