Data-driven grapheme-to-phoneme representations for a lexicon-free text-to-speech

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Garg, Abhinav, Kim, Jiyeon, Khyalia, Sushil, Kim, Chanwoo, Gowda, Dhananjaya
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917570545713152
author Garg, Abhinav
Kim, Jiyeon
Khyalia, Sushil
Kim, Chanwoo
Gowda, Dhananjaya
author_facet Garg, Abhinav
Kim, Jiyeon
Khyalia, Sushil
Kim, Chanwoo
Gowda, Dhananjaya
contents Grapheme-to-Phoneme (G2P) is an essential first step in any modern, high-quality Text-to-Speech (TTS) system. Most of the current G2P systems rely on carefully hand-crafted lexicons developed by experts. This poses a two-fold problem. Firstly, the lexicons are generated using a fixed phoneme set, usually, ARPABET or IPA, which might not be the most optimal way to represent phonemes for all languages. Secondly, the man-hours required to produce such an expert lexicon are very high. In this paper, we eliminate both of these issues by using recent advances in self-supervised learning to obtain data-driven phoneme representations instead of fixed representations. We compare our lexicon-free approach against strong baselines that utilize a well-crafted lexicon. Furthermore, we show that our data-driven lexicon-free method performs as good or even marginally better than the conventional rule-based or lexicon-based neural G2Ps in terms of Mean Opinion Score (MOS) while using no prior language lexicon or phoneme set, i.e. no linguistic expertise.
format Preprint
id arxiv_https___arxiv_org_abs_2401_10465
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Data-driven grapheme-to-phoneme representations for a lexicon-free text-to-speech
Garg, Abhinav
Kim, Jiyeon
Khyalia, Sushil
Kim, Chanwoo
Gowda, Dhananjaya
Computation and Language
Sound
Audio and Speech Processing
Grapheme-to-Phoneme (G2P) is an essential first step in any modern, high-quality Text-to-Speech (TTS) system. Most of the current G2P systems rely on carefully hand-crafted lexicons developed by experts. This poses a two-fold problem. Firstly, the lexicons are generated using a fixed phoneme set, usually, ARPABET or IPA, which might not be the most optimal way to represent phonemes for all languages. Secondly, the man-hours required to produce such an expert lexicon are very high. In this paper, we eliminate both of these issues by using recent advances in self-supervised learning to obtain data-driven phoneme representations instead of fixed representations. We compare our lexicon-free approach against strong baselines that utilize a well-crafted lexicon. Furthermore, we show that our data-driven lexicon-free method performs as good or even marginally better than the conventional rule-based or lexicon-based neural G2Ps in terms of Mean Opinion Score (MOS) while using no prior language lexicon or phoneme set, i.e. no linguistic expertise.
title Data-driven grapheme-to-phoneme representations for a lexicon-free text-to-speech
topic Computation and Language
Sound
Audio and Speech Processing
url https://arxiv.org/abs/2401.10465