TMD-TTS: A Unified Tibetan Multi-Dialect Text-to-Speech Framework for Ü-Tsang, Amdo and Kham Speech Dataset Generation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liu, Yutong, Zhang, Ziyue, Ma-bao, Ban, Duojie, Renzeng, Cai, Yuqing, Yu, Yongbin, Wang, Xiangxiang, Gao, Fan, Huang, Cheng, Tashi, Nyima
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915942606307328
author Liu, Yutong
Zhang, Ziyue
Ma-bao, Ban
Duojie, Renzeng
Cai, Yuqing
Yu, Yongbin
Wang, Xiangxiang
Gao, Fan
Huang, Cheng
Tashi, Nyima
author_facet Liu, Yutong
Zhang, Ziyue
Ma-bao, Ban
Duojie, Renzeng
Cai, Yuqing
Yu, Yongbin
Wang, Xiangxiang
Gao, Fan
Huang, Cheng
Tashi, Nyima
contents Tibetan is a low-resource language with limited parallel speech corpora spanning its three major dialects (Ü-Tsang, Amdo, and Kham), limiting progress in speech modeling. To address this issue, we propose TMD-TTS, a unified Tibetan multi-dialect text-to-speech (TTS) framework that synthesizes parallel dialectal speech from explicit dialect labels. Our method features a dialect fusion module and a Dialect-Specialized Dynamic Routing Network (DSDR-Net) to capture fine-grained acoustic and linguistic variations across dialects. Extensive objective and subjective evaluations demonstrate that TMD-TTS significantly outperforms baselines in dialectal expressiveness. We further validate the quality and utility of the synthesized speech through a challenging Speech-to-Speech Dialect Conversion (S2SDC) task.
format Preprint
id arxiv_https___arxiv_org_abs_2509_18060
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle TMD-TTS: A Unified Tibetan Multi-Dialect Text-to-Speech Framework for Ü-Tsang, Amdo and Kham Speech Dataset Generation
Liu, Yutong
Zhang, Ziyue
Ma-bao, Ban
Duojie, Renzeng
Cai, Yuqing
Yu, Yongbin
Wang, Xiangxiang
Gao, Fan
Huang, Cheng
Tashi, Nyima
Computation and Language
Artificial Intelligence
Tibetan is a low-resource language with limited parallel speech corpora spanning its three major dialects (Ü-Tsang, Amdo, and Kham), limiting progress in speech modeling. To address this issue, we propose TMD-TTS, a unified Tibetan multi-dialect text-to-speech (TTS) framework that synthesizes parallel dialectal speech from explicit dialect labels. Our method features a dialect fusion module and a Dialect-Specialized Dynamic Routing Network (DSDR-Net) to capture fine-grained acoustic and linguistic variations across dialects. Extensive objective and subjective evaluations demonstrate that TMD-TTS significantly outperforms baselines in dialectal expressiveness. We further validate the quality and utility of the synthesized speech through a challenging Speech-to-Speech Dialect Conversion (S2SDC) task.
title TMD-TTS: A Unified Tibetan Multi-Dialect Text-to-Speech Framework for Ü-Tsang, Amdo and Kham Speech Dataset Generation
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2509.18060