Image de couverture de livre

Cross-modal Consistency Guidance for Robust Emotion Control in Auto-Regressive TTS Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Peng, Yizhou, Ma, Yukun, Zhang, Chong, Chao, Yi-Wen, Ni, Chongjia, Ma, Bin, Chng, Eng Siong
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

FD-Bench: A Full-Duplex Benchmarking Pipeline Designed for Full Duplex Spoken Dialogue Systems
par: Peng, Yizhou, et autres
Publié: (2025)

Zero-shot Context Biasing with Trie-based Decoding using Synthetic Multi-Pronunciation
par: Liu, Changsong, et autres
Publié: (2025)

Bi-directional Context-Enhanced Speech Large Language Models for Multilingual Conversational ASR
par: Peng, Yizhou, et autres
Publié: (2025)

Proactive for Uncertainty: Cause-Aware Error Diagnosis and Interactive Clarification for Spoken Dialogue Systems
par: Peng, Yizhou, et autres
Publié: (2026)

NTU Speechlab LLM-Based Multilingual ASR System for Interspeech MLC-SLM Challenge 2025
par: Peng, Yizhou, et autres
Publié: (2025)

Prosodic Boundary-Aware Streaming Generation for LLM-Based TTS with Streaming Text Input
par: Liu, Changsong, et autres
Publié: (2026)

Bridging Speech and Text: Enhancing ASR with Pinyin-to-Character Pre-training in LLMs
par: Yuhang, Yang, et autres
Publié: (2024)

Continual Learning Optimizations for Auto-regressive Decoder of Multilingual ASR systems
par: Kwok, Chin Yuen, et autres
Publié: (2024)

Robust Zero-Shot Text-to-Speech Synthesis with Reverse Inference Optimization
par: Hu, Yuchen, et autres
Publié: (2024)

Large Language Models Meet Contrastive Learning: Zero-Shot Emotion Recognition Across Languages
par: Zou, Heqing, et autres
Publié: (2025)

Improving Code-Switching Speech Recognition with TTS Data Augmentation
par: Yeo, Yue Heng, et autres
Publié: (2026)

Punctuation Restoration for Singaporean Spoken Languages: English, Malay, and Mandarin
par: Rao, Abhinav, et autres
Publié: (2022)

Hierarchical Self-Supervised Representation Learning for Depression Detection from Speech
par: Li, Yuxin, et autres
Publié: (2025)

Audio-CoT: Exploring Chain-of-Thought Reasoning in Large Audio Language Model
par: Ma, Ziyang, et autres
Publié: (2025)

SPGM: Prioritizing Local Features for enhanced speech separation performance
par: Yip, Jia Qi, et autres
Publié: (2023)

Enhancing Zero-shot Text-to-Speech Synthesis with Human Feedback
par: Chen, Chen, et autres
Publié: (2024)

Improving Synthetic Data Training for Contextual Biasing Models with a Keyword-Aware Cost Function
par: Kwok, Chin Yuen, et autres
Publié: (2025)

Continual Learning with Embedding Layer Surgery and Task-wise Beam Search using Whisper
par: Kwok, Chin Yuen, et autres
Publié: (2025)

IndexTTS2: A Breakthrough in Emotionally Expressive and Duration-Controlled Auto-Regressive Zero-Shot Text-to-Speech
par: Zhou, Siyi, et autres
Publié: (2025)

Explainable Disentanglement on Discrete Speech Representations for Noise-Robust ASR
par: Gopal, Shreyas, et autres
Publié: (2025)

Language-Aware Distillation for Multilingual Instruction-Following Speech LLMs with ASR-Only Supervision
par: Gopal, Shreyas, et autres
Publié: (2026)

DiaSynth: Synthetic Dialogue Generation Framework for Low Resource Dialogue Applications
par: Suresh, Sathya Krishnan, et autres
Publié: (2024)

Phonetic Enhanced Language Modeling for Text-to-Speech Synthesis
par: Zhou, Kun, et autres
Publié: (2024)

Multi-band Frequency Reconstruction for Neural Psychoacoustic Coding
par: Ng, Dianwen, et autres
Publié: (2025)

CS-Sum: A Benchmark for Code-Switching Dialogue Summarization and the Limits of Large Language Models
par: Suresh, Sathya Krishnan, et autres
Publié: (2025)

StreamVoiceAnon+: Emotion-Preserving Streaming Speaker Anonymization via Frame-Level Acoustic Distillation
par: Kuzmin, Nikita, et autres
Publié: (2026)

Leveraging Speech PTM, Text LLM, and Emotional TTS for Speech Emotion Recognition
par: Ma, Ziyang, et autres
Publié: (2023)

EASY: Emotion-aware Speaker Anonymization via Factorized Distillation
par: Yao, Jixun, et autres
Publié: (2025)

MULTI-Bench: A Multi-Turn Interactive Benchmark for Assessing Emotional Intelligence ability of Spoken Dialogue Models
par: Deng, Yayue, et autres
Publié: (2025)

Speech Separation using Neural Audio Codecs with Embedding Loss
par: Yip, Jia Qi, et autres
Publié: (2024)

Noro: Noise-Robust One-shot Voice Conversion with Hidden Speaker Representation Learning
par: He, Haorui, et autres
Publié: (2024)

Audio Large Language Models Can Be Descriptive Speech Quality Evaluators
par: Chen, Chen, et autres
Publié: (2025)

DepFlow: Disentangled Speech Generation to Mitigate Semantic Bias in Depression Detection
par: Li, Yuxin, et autres
Publié: (2026)

Listen Again and Choose the Right Answer: A New Paradigm for Automatic Speech Recognition with Large Language Models
par: Hu, Yuchen, et autres
Publié: (2024)

Self-Taught Recognizer: Toward Unsupervised Adaptation for Speech Foundation Models
par: Hu, Yuchen, et autres
Publié: (2024)

VocalParse: Towards Unified and Scalable Singing Voice Transcription with Large Audio Language Models
par: Chen, Yukun, et autres
Publié: (2026)

InspireMusic: Integrating Super Resolution and Large Language Model for High-Fidelity Long-Form Music Generation
par: Zhang, Chong, et autres
Publié: (2025)

The Interspeech 2026 Audio Reasoning Challenge: Evaluating Reasoning Process Quality for Audio Reasoning Models and Agents
par: Ma, Ziyang, et autres
Publié: (2026)

Expressive Prompting: Improving Emotion Intensity and Speaker Consistency in Zero-Shot TTS
par: Wang, Haoyu, et autres
Publié: (2024)

Towards Audio Codec-based Speech Separation
par: Yip, Jia Qi, et autres
Publié: (2024)