Image de couverture de livre

Combining Masked Language Modeling and Cross-Modal Contrastive Learning for Prosody-Aware TTS

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Borodin, Kirill, Kudryavtsev, Vasiliy, Maslov, Maxim, Vasiliev, Nikita, Gorodnichev, Mikhail, Mkrtchian, Grach
Format:	Preprint
Publié:	2026
Sujets:	Sound Audio and Speech Processing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Balalaika: Data-Centric, Prosody-Aware Annotation Pipeline for Russian Speech
par: Borodin, Kirill, et autres
Publié: (2025)

When Spoof Detectors Travel: Evaluation Across 66 Languages in the Low-Resource Language Spoofing Corpus
par: Borodin, Kirill, et autres
Publié: (2026)

Interpreting Multi-Branch Anti-Spoofing Architectures: Correlating Internal Strategy with Empirical Performance
par: Viakhirev, Ivan, et autres
Publié: (2026)

Application of ASV for Voice Identification after VC and Duration Predictor Improvement in TTS Models
par: Nikolayevich, Borodin Kirill, et autres
Publié: (2024)

AASIST3: KAN-Enhanced AASIST Speech Deepfake Detection using SSL Features and Additional Regularization for the ASVspoof 2024 Challenge
par: Borodin, Kirill, et autres
Publié: (2024)

Towards Scalable AASIST: Refining Graph Attention for Speech Deepfake Detection
par: Viakhirev, Ivan, et autres
Publié: (2025)

No Verifiable Reward for Prosody: Toward Preference-Guided Prosody Learning in TTS
par: Shin, Seungyoun, et autres
Publié: (2025)

Daisy-TTS: Simulating Wider Spectrum of Emotions via Prosody Embedding Decomposition
par: Chevi, Rendi, et autres
Publié: (2024)

Counterfactual Activation Editing for Post-hoc Prosody and Mispronunciation Correction in TTS Models
par: Lee, Kyowoon, et autres
Publié: (2025)

Stable-TTS: Stable Speaker-Adaptive Text-to-Speech Synthesis via Prosody Prompting
par: Han, Wooseok, et autres
Publié: (2024)

Zero-shot Cross-lingual Voice Transfer for TTS
par: Biadsy, Fadi, et autres
Publié: (2024)

AutoProsody: A Prosodic Feature Extraction Tool for Indian Languages
par: Thinakaran, Preethi, et autres
Publié: (2025)

Multi-Modal Automatic Prosody Annotation with Contrastive Pretraining of SSWP
par: Zhong, Jinzuomu, et autres
Publié: (2023)

SponTTS: modeling and transferring spontaneous style for TTS
par: Li, Hanzhao, et autres
Publié: (2023)

E1 TTS: Simple and Fast Non-Autoregressive TTS
par: Liu, Zhijun, et autres
Publié: (2024)

DAIEN-TTS: Disentangled Audio Infilling for Environment-Aware Text-to-Speech Synthesis
par: Lu, Ye-Xin, et autres
Publié: (2025)

Prosody Labeling with Phoneme-BERT and Speech Foundation Models
par: Koriyama, Tomoki
Publié: (2025)

VECL-TTS: Voice identity and Emotional style controllable Cross-Lingual Text-to-Speech
par: Gudmalwar, Ashishkumar, et autres
Publié: (2024)

E2 TTS: Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS
par: Eskimez, Sefik Emre, et autres
Publié: (2024)

ManaTTS Persian: a recipe for creating TTS datasets for lower resource languages
par: Qharabagh, Mahta Fetrat, et autres
Publié: (2024)

Towards Expressive Zero-Shot Speech Synthesis with Hierarchical Prosody Modeling
par: Jiang, Yuepeng, et autres
Publié: (2024)

Minimizing Modality Gap from the Input Side: Your Speech LLM Can Be a Prosody-Aware Text LLM
par: Cui, Wenqian, et autres
Publié: (2026)

DINO-VITS: Data-Efficient Zero-Shot TTS with Self-Supervised Speaker Verification Loss for Noise Robustness
par: Pankov, Vikentii, et autres
Publié: (2023)

MoE-TTS: Enhancing Out-of-Domain Text Understanding for Description-based TTS via Mixture-of-Experts
par: Xue, Heyang, et autres
Publié: (2025)

Emotion-Aware Contrastive Adaptation Network for Source-Free Cross-Corpus Speech Emotion Recognition
par: Zhao, Yan, et autres
Publié: (2024)

ED-TTS: Multi-Scale Emotion Modeling using Cross-Domain Emotion Diarization for Emotional Speech Synthesis
par: Tang, Haobin, et autres
Publié: (2024)

DiffProsody: Diffusion-based Latent Prosody Generation for Expressive Speech Synthesis with Prosody Conditional Adversarial Training
par: Oh, Hyung-Seok, et autres
Publié: (2023)

Phone-Level Prosody Modelling with GMM-Based MDN for Diverse and Controllable Speech Synthesis
par: Du, Chenpeng, et autres
Publié: (2021)

CLaM-TTS: Improving Neural Codec Language Model for Zero-Shot Text-to-Speech
par: Kim, Jaehyeon, et autres
Publié: (2024)

UniVoice: Unifying Autoregressive ASR and Flow-Matching based TTS with Large Language Models
par: Guan, Wenhao, et autres
Publié: (2025)

Towards Developing State-of-the-Art TTS Synthesisers for 13 Indian Languages with Signal Processing aided Alignments
par: Prakash, Anusha, et autres
Publié: (2022)

Prosody Analysis of Audiobooks
par: Pethe, Charuta, et autres
Publié: (2023)

Accent-VITS:accent transfer for end-to-end TTS
par: Ma, Linhan, et autres
Publié: (2023)

A Dataset for Automatic Assessment of TTS Quality in Spanish
par: Welford, Alejandro Sosa, et autres
Publié: (2025)

Intelli-Z: Toward Intelligible Zero-Shot TTS
par: Jung, Sunghee, et autres
Publié: (2024)

ViT-TTS: Visual Text-to-Speech with Scalable Diffusion Transformer
par: Liu, Huadai, et autres
Publié: (2023)

SPADE: Structured Pruning and Adaptive Distillation for Efficient LLM-TTS
par: Nguyen, Tan Dat, et autres
Publié: (2025)

Enhancing TTS Stability in Hebrew using Discrete Semantic Units
par: Zeldes, Ella, et autres
Publié: (2024)

Continuous-Token Diffusion for Speaker-Referenced TTS in Multimodal LLMs
par: He, Xinlu, et autres
Publié: (2025)

EME-TTS: Unlocking the Emphasis and Emotion Link in Speech Synthesis
par: Li, Haoxun, et autres
Publié: (2025)