Saved in:
Bibliographic Details
Main Authors: Ong, Michael, Robertson, Sean, Peckham, Leo, de Aberasturi, Alba Jorquera Jimenez, Arkhangorodsky, Paula, Huo, Robin, Sakhardande, Aman, Hallap, Mark, Nagy, Naomi, Dunbar, Ewan
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2409.08103
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910968101994496
author Ong, Michael
Robertson, Sean
Peckham, Leo
de Aberasturi, Alba Jorquera Jimenez
Arkhangorodsky, Paula
Huo, Robin
Sakhardande, Aman
Hallap, Mark
Nagy, Naomi
Dunbar, Ewan
author_facet Ong, Michael
Robertson, Sean
Peckham, Leo
de Aberasturi, Alba Jorquera Jimenez
Arkhangorodsky, Paula
Huo, Robin
Sakhardande, Aman
Hallap, Mark
Nagy, Naomi
Dunbar, Ewan
contents We introduce the Faetar Automatic Speech Recognition Benchmark, a benchmark corpus designed to push the limits of current approaches to low-resource speech recognition. Faetar, a Franco-Provençal variety spoken primarily in Italy, has no standard orthography, has virtually no existing textual or speech resources other than what is included in the benchmark, and is quite different from other forms of Franco-Provençal. The corpus comes from field recordings, most of which are noisy, for which only 5 hrs have matching transcriptions, and for which forced alignment is of variable quality. The corpus contains an additional 20 hrs of unlabelled speech. We report baseline results from state-of-the-art multilingual speech foundation models with a best phone error rate of 30.4%, using a pipeline that continues pre-training on the foundation model using the unlabelled set.
format Preprint
id arxiv_https___arxiv_org_abs_2409_08103
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle The Faetar Benchmark: Speech Recognition in a Very Under-Resourced Language
Ong, Michael
Robertson, Sean
Peckham, Leo
de Aberasturi, Alba Jorquera Jimenez
Arkhangorodsky, Paula
Huo, Robin
Sakhardande, Aman
Hallap, Mark
Nagy, Naomi
Dunbar, Ewan
Computation and Language
Sound
Audio and Speech Processing
We introduce the Faetar Automatic Speech Recognition Benchmark, a benchmark corpus designed to push the limits of current approaches to low-resource speech recognition. Faetar, a Franco-Provençal variety spoken primarily in Italy, has no standard orthography, has virtually no existing textual or speech resources other than what is included in the benchmark, and is quite different from other forms of Franco-Provençal. The corpus comes from field recordings, most of which are noisy, for which only 5 hrs have matching transcriptions, and for which forced alignment is of variable quality. The corpus contains an additional 20 hrs of unlabelled speech. We report baseline results from state-of-the-art multilingual speech foundation models with a best phone error rate of 30.4%, using a pipeline that continues pre-training on the foundation model using the unlabelled set.
title The Faetar Benchmark: Speech Recognition in a Very Under-Resourced Language
topic Computation and Language
Sound
Audio and Speech Processing
url https://arxiv.org/abs/2409.08103