Breeze Taigi: Benchmarks and Models for Taiwanese Hokkien Speech Recognition and Synthesis

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Lan, Yu-Siang, Liu, Chia-Sheng, Chen, Yi-Chang, Hsu, Po-Chun, Chiu, Allyson, Lin, Shun-Wen, Shiu, Da-shan, Liao, Yuan-Fu
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911530796187648
author Lan, Yu-Siang
Liu, Chia-Sheng
Chen, Yi-Chang
Hsu, Po-Chun
Chiu, Allyson
Lin, Shun-Wen
Shiu, Da-shan
Liao, Yuan-Fu
author_facet Lan, Yu-Siang
Liu, Chia-Sheng
Chen, Yi-Chang
Hsu, Po-Chun
Chiu, Allyson
Lin, Shun-Wen
Shiu, Da-shan
Liao, Yuan-Fu
contents Taiwanese Hokkien (Taigi) presents unique opportunities for advancing speech technology methodologies that can generalize to diverse linguistic contexts. We introduce Breeze Taigi, a comprehensive framework centered on standardized benchmarks for evaluating Taigi speech recognition and synthesis systems. Our primary contribution is a reproducible evaluation methodology that leverages parallel Taiwanese Mandarin resources. We provide 30 carefully curated Mandarin-Taigi audio pairs from Taiwan's Executive Yuan public service announcements with normalized ground truth transcriptions. We establish Character Error Rate (CER) as the standard metric and implement normalization procedures to enable fair cross-system comparisons. To demonstrate the benchmark's utility and provide reference implementations, we develop speech recognition and synthesis models through a methodology that leverages existing Taiwanese Mandarin resources and large-scale synthetic data generation. In particular, we fine-tune a Whisper model on approximately 10,000 hours of Taigi synthetic speech data. Our ASR model achieves 30.13% average CER on the benchmark, outperforming existing commercial and research systems. By providing standardized evaluation protocols, diverse training datasets, and open baseline models, we offer a replicable framework with methodologies applicable to various linguistic contexts.
format Preprint
id arxiv_https___arxiv_org_abs_2603_19259
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Breeze Taigi: Benchmarks and Models for Taiwanese Hokkien Speech Recognition and Synthesis
Lan, Yu-Siang
Liu, Chia-Sheng
Chen, Yi-Chang
Hsu, Po-Chun
Chiu, Allyson
Lin, Shun-Wen
Shiu, Da-shan
Liao, Yuan-Fu
Computation and Language
Artificial Intelligence
Taiwanese Hokkien (Taigi) presents unique opportunities for advancing speech technology methodologies that can generalize to diverse linguistic contexts. We introduce Breeze Taigi, a comprehensive framework centered on standardized benchmarks for evaluating Taigi speech recognition and synthesis systems. Our primary contribution is a reproducible evaluation methodology that leverages parallel Taiwanese Mandarin resources. We provide 30 carefully curated Mandarin-Taigi audio pairs from Taiwan's Executive Yuan public service announcements with normalized ground truth transcriptions. We establish Character Error Rate (CER) as the standard metric and implement normalization procedures to enable fair cross-system comparisons. To demonstrate the benchmark's utility and provide reference implementations, we develop speech recognition and synthesis models through a methodology that leverages existing Taiwanese Mandarin resources and large-scale synthetic data generation. In particular, we fine-tune a Whisper model on approximately 10,000 hours of Taigi synthetic speech data. Our ASR model achieves 30.13% average CER on the benchmark, outperforming existing commercial and research systems. By providing standardized evaluation protocols, diverse training datasets, and open baseline models, we offer a replicable framework with methodologies applicable to various linguistic contexts.
title Breeze Taigi: Benchmarks and Models for Taiwanese Hokkien Speech Recognition and Synthesis
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2603.19259