Fotheidil: an Automatic Transcription System for the Irish Language
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910769085415424 |
|---|---|
| author | Lonergan, Liam Saratxaga, Ibon Sloan, John Maharog, Oscar Qian, Mengjie Chiaráin, Neasa Ní Gobl, Christer Chasaide, Ailbhe Ní |
| author_facet | Lonergan, Liam Saratxaga, Ibon Sloan, John Maharog, Oscar Qian, Mengjie Chiaráin, Neasa Ní Gobl, Christer Chasaide, Ailbhe Ní |
| contents | This paper sets out the first web-based transcription system for the Irish language - Fotheidil, a system that utilises speech-related AI technologies as part of the ABAIR initiative. The system includes both off-the-shelf pre-trained voice activity detection and speaker diarisation models and models trained specifically for Irish automatic speech recognition and capitalisation and punctuation restoration. Semi-supervised learning is explored to improve the acoustic model of a modular TDNN-HMM ASR system, yielding substantial improvements for out-of-domain test sets and dialects that are underrepresented in the supervised training set. A novel approach to capitalisation and punctuation restoration involving sequence-to-sequence models is compared with the conventional approach using a classification model. Experimental results show here also substantial improvements in performance. The system will be made freely available for public use, and represents an important resource to researchers and others who transcribe Irish language materials. Human-corrected transcriptions will be collected and included in the training dataset as the system is used, which should lead to incremental improvements to the ASR model in a cyclical, community-driven fashion. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_00509 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Fotheidil: an Automatic Transcription System for the Irish Language Lonergan, Liam Saratxaga, Ibon Sloan, John Maharog, Oscar Qian, Mengjie Chiaráin, Neasa Ní Gobl, Christer Chasaide, Ailbhe Ní Computation and Language Sound Audio and Speech Processing This paper sets out the first web-based transcription system for the Irish language - Fotheidil, a system that utilises speech-related AI technologies as part of the ABAIR initiative. The system includes both off-the-shelf pre-trained voice activity detection and speaker diarisation models and models trained specifically for Irish automatic speech recognition and capitalisation and punctuation restoration. Semi-supervised learning is explored to improve the acoustic model of a modular TDNN-HMM ASR system, yielding substantial improvements for out-of-domain test sets and dialects that are underrepresented in the supervised training set. A novel approach to capitalisation and punctuation restoration involving sequence-to-sequence models is compared with the conventional approach using a classification model. Experimental results show here also substantial improvements in performance. The system will be made freely available for public use, and represents an important resource to researchers and others who transcribe Irish language materials. Human-corrected transcriptions will be collected and included in the training dataset as the system is used, which should lead to incremental improvements to the ASR model in a cyclical, community-driven fashion. |
| title | Fotheidil: an Automatic Transcription System for the Irish Language |
| topic | Computation and Language Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2501.00509 |