TaigiSpeech: A Low-Resource Real-World Speech Intent Dataset and Preliminary Results with Scalable Data Mining In-the-Wild

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Chang, Kai-Wei, Lin, Yi-Cheng, Chou, Huang-Cheng, Ren, Wenze, Huang, Yu-Han, Tsai, Yun-Shao, Chen, Chien-Cheng, Tsao, Yu, Liao, Yuan-Fu, Narayanan, Shrikanth, Glass, James, Lee, Hung-yi
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911535892267008
author Chang, Kai-Wei
Lin, Yi-Cheng
Chou, Huang-Cheng
Ren, Wenze
Huang, Yu-Han
Tsai, Yun-Shao
Chen, Chien-Cheng
Tsao, Yu
Liao, Yuan-Fu
Narayanan, Shrikanth
Glass, James
Lee, Hung-yi
author_facet Chang, Kai-Wei
Lin, Yi-Cheng
Chou, Huang-Cheng
Ren, Wenze
Huang, Yu-Han
Tsai, Yun-Shao
Chen, Chien-Cheng
Tsao, Yu
Liao, Yuan-Fu
Narayanan, Shrikanth
Glass, James
Lee, Hung-yi
contents Speech technologies have advanced rapidly and serve diverse populations worldwide. However, many languages remain underrepresented due to limited resources. In this paper, we introduce \textbf{TaigiSpeech}, a real-world speech intent dataset in Taiwanese Taigi (aka Taiwanese Hokkien/Southern Min), which is a low-resource and primarily spoken language. The dataset is collected from older adults, comprising 21 speakers with a total of 3k utterances. It is designed for practical intent detection scenarios, including healthcare and home assistant applications. To address the scarcity of labeled data, we explore two data mining strategies with two levels of supervision: keyword match data mining with LLM pseudo labeling via an intermediate language and an audio-visual framework that leverages multimodal cues with minimal textual supervision. This design enables scalable dataset construction for low-resource and unwritten spoken languages. TaigiSpeech will be released under the CC BY 4.0 license to facilitate broad adoption and research on low-resource and unwritten languages. The project website and the dataset can be found on https://kwchang.org/taigispeech.
format Preprint
id arxiv_https___arxiv_org_abs_2603_21478
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle TaigiSpeech: A Low-Resource Real-World Speech Intent Dataset and Preliminary Results with Scalable Data Mining In-the-Wild
Chang, Kai-Wei
Lin, Yi-Cheng
Chou, Huang-Cheng
Ren, Wenze
Huang, Yu-Han
Tsai, Yun-Shao
Chen, Chien-Cheng
Tsao, Yu
Liao, Yuan-Fu
Narayanan, Shrikanth
Glass, James
Lee, Hung-yi
Computation and Language
Machine Learning
Audio and Speech Processing
Speech technologies have advanced rapidly and serve diverse populations worldwide. However, many languages remain underrepresented due to limited resources. In this paper, we introduce \textbf{TaigiSpeech}, a real-world speech intent dataset in Taiwanese Taigi (aka Taiwanese Hokkien/Southern Min), which is a low-resource and primarily spoken language. The dataset is collected from older adults, comprising 21 speakers with a total of 3k utterances. It is designed for practical intent detection scenarios, including healthcare and home assistant applications. To address the scarcity of labeled data, we explore two data mining strategies with two levels of supervision: keyword match data mining with LLM pseudo labeling via an intermediate language and an audio-visual framework that leverages multimodal cues with minimal textual supervision. This design enables scalable dataset construction for low-resource and unwritten spoken languages. TaigiSpeech will be released under the CC BY 4.0 license to facilitate broad adoption and research on low-resource and unwritten languages. The project website and the dataset can be found on https://kwchang.org/taigispeech.
title TaigiSpeech: A Low-Resource Real-World Speech Intent Dataset and Preliminary Results with Scalable Data Mining In-the-Wild
topic Computation and Language
Machine Learning
Audio and Speech Processing
url https://arxiv.org/abs/2603.21478