Habibi: Laying the Open-Source Foundation of Unified-Dialectal Arabic Speech Synthesis

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Chen, Yushen, Liu, Junzhe, Tu, Yujie, Niu, Zhikang, Liang, Yuzhe, Qiang, Chunyu, Zhang, Chen, Yu, Kai, Chen, Xie
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911557242322944
author Chen, Yushen
Liu, Junzhe
Tu, Yujie
Niu, Zhikang
Liang, Yuzhe
Qiang, Chunyu
Zhang, Chen
Yu, Kai
Chen, Xie
author_facet Chen, Yushen
Liu, Junzhe
Tu, Yujie
Niu, Zhikang
Liang, Yuzhe
Qiang, Chunyu
Zhang, Chen
Yu, Kai
Chen, Xie
contents Arabic spans over 30 spoken varieties, yet no open-source text-to-speech system unifies them. Key barriers include substantial cross-dialect lexical and phonological divergence, scarce synthesis-grade data, and the absence of a standardized multi-dialect evaluation benchmark. We present Habibi, a unified-dialectal Arabic TTS framework that addresses all three. Through a multi-step curation pipeline, we repurpose open-source ASR corpora into TTS training data covering 12+ regional dialects. A linguistically-informed curriculum learning strategy - progressing from Modern Standard Arabic to dialectal data - enables robust zero-shot synthesis without text diacritization. We further release the first standardized multi-dialect Arabic TTS benchmark, comprising over 11,000 utterances across 7 dialect subsets with manually verified transcripts. On this benchmark, our unified model matches or surpasses per-dialect specialized models. Both automatic metrics and human evaluations confirm that Habibi is highly competitive with ElevenLabs' Eleven v3 (alpha) in intelligibility, speaker similarity, and naturalness. Extensive ablations (~8,000 H100 GPU hours, 30+ configurations) validate each design choice. We open-source all checkpoints, training and inference code, and benchmark data - the first such release for multi-dialect Arabic TTS - at https://SWivid.github.io/Habibi/ .
format Preprint
id arxiv_https___arxiv_org_abs_2601_13802
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Habibi: Laying the Open-Source Foundation of Unified-Dialectal Arabic Speech Synthesis
Chen, Yushen
Liu, Junzhe
Tu, Yujie
Niu, Zhikang
Liang, Yuzhe
Qiang, Chunyu
Zhang, Chen
Yu, Kai
Chen, Xie
Computation and Language
Sound
Audio and Speech Processing
Arabic spans over 30 spoken varieties, yet no open-source text-to-speech system unifies them. Key barriers include substantial cross-dialect lexical and phonological divergence, scarce synthesis-grade data, and the absence of a standardized multi-dialect evaluation benchmark. We present Habibi, a unified-dialectal Arabic TTS framework that addresses all three. Through a multi-step curation pipeline, we repurpose open-source ASR corpora into TTS training data covering 12+ regional dialects. A linguistically-informed curriculum learning strategy - progressing from Modern Standard Arabic to dialectal data - enables robust zero-shot synthesis without text diacritization. We further release the first standardized multi-dialect Arabic TTS benchmark, comprising over 11,000 utterances across 7 dialect subsets with manually verified transcripts. On this benchmark, our unified model matches or surpasses per-dialect specialized models. Both automatic metrics and human evaluations confirm that Habibi is highly competitive with ElevenLabs' Eleven v3 (alpha) in intelligibility, speaker similarity, and naturalness. Extensive ablations (~8,000 H100 GPU hours, 30+ configurations) validate each design choice. We open-source all checkpoints, training and inference code, and benchmark data - the first such release for multi-dialect Arabic TTS - at https://SWivid.github.io/Habibi/ .
title Habibi: Laying the Open-Source Foundation of Unified-Dialectal Arabic Speech Synthesis
topic Computation and Language
Sound
Audio and Speech Processing
url https://arxiv.org/abs/2601.13802