AMNet: An Acoustic Model Network for Enhanced Mandarin Speech Synthesis

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Cao, Yubing, Yu, Yinfeng, Li, Yongming, Wang, Liejun
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916687543009280
author Cao, Yubing
Yu, Yinfeng
Li, Yongming
Wang, Liejun
author_facet Cao, Yubing
Yu, Yinfeng
Li, Yongming
Wang, Liejun
contents This paper presents AMNet, an Acoustic Model Network designed to improve the performance of Mandarin speech synthesis by incorporating phrase structure annotation and local convolution modules. AMNet builds upon the FastSpeech 2 architecture while addressing the challenge of local context modeling, which is crucial for capturing intricate speech features such as pauses, stress, and intonation. By embedding a phrase structure parser into the model and introducing a local convolution module, AMNet enhances the model's sensitivity to local information. Additionally, AMNet decouples tonal characteristics from phonemes, providing explicit guidance for tone modeling, which improves tone accuracy and pronunciation. Experimental results demonstrate that AMNet outperforms baseline models in subjective and objective evaluations. The proposed model achieves superior Mean Opinion Scores (MOS), lower Mel Cepstral Distortion (MCD), and improved fundamental frequency fitting $F0 (R^2)$, confirming its ability to generate high-quality, natural, and expressive Mandarin speech.
format Preprint
id arxiv_https___arxiv_org_abs_2504_09225
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle AMNet: An Acoustic Model Network for Enhanced Mandarin Speech Synthesis
Cao, Yubing
Yu, Yinfeng
Li, Yongming
Wang, Liejun
Sound
Artificial Intelligence
Audio and Speech Processing
This paper presents AMNet, an Acoustic Model Network designed to improve the performance of Mandarin speech synthesis by incorporating phrase structure annotation and local convolution modules. AMNet builds upon the FastSpeech 2 architecture while addressing the challenge of local context modeling, which is crucial for capturing intricate speech features such as pauses, stress, and intonation. By embedding a phrase structure parser into the model and introducing a local convolution module, AMNet enhances the model's sensitivity to local information. Additionally, AMNet decouples tonal characteristics from phonemes, providing explicit guidance for tone modeling, which improves tone accuracy and pronunciation. Experimental results demonstrate that AMNet outperforms baseline models in subjective and objective evaluations. The proposed model achieves superior Mean Opinion Scores (MOS), lower Mel Cepstral Distortion (MCD), and improved fundamental frequency fitting $F0 (R^2)$, confirming its ability to generate high-quality, natural, and expressive Mandarin speech.
title AMNet: An Acoustic Model Network for Enhanced Mandarin Speech Synthesis
topic Sound
Artificial Intelligence
Audio and Speech Processing
url https://arxiv.org/abs/2504.09225