Imagen de Portada

VividVoice: A Unified Framework for Scene-Aware Visually-Driven Speech Synthesis

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Ma, Chengyuan, Jin, Jiawei, Xiong, Ruijie, Jin, Chunxiang, Yan, Canxiang, Yang, Wenming
Formato:	Preprint
Publicado:	2026
Materias:	Sound Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

TLDiffGAN: A Latent Diffusion-GAN Framework with Temporal Information Fusion for Anomalous Sound Detection
por: Ma, Chengyuan, et al.
Publicado: (2026)

VoiceShop: A Unified Speech-to-Speech Framework for Identity-Preserving Zero-Shot Voice Editing
por: Anastassiou, Philip, et al.
Publicado: (2024)

Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representation
por: Yan, Canxiang, et al.
Publicado: (2025)

UniSS: Unified Expressive Speech-to-Speech Translation with Your Voice
por: Cheng, Sitong, et al.
Publicado: (2025)

ReStyle-TTS: Relative and Continuous Style Control for Zero-Shot Speech Synthesis
por: Li, Haitao, et al.
Publicado: (2026)

AutoStyle-TTS: Retrieval-Augmented Generation based Automatic Style Matching Text-to-Speech Synthesis
por: Luo, Dan, et al.
Publicado: (2025)

Vevo2: A Unified and Controllable Framework for Speech and Singing Voice Generation
por: Zhang, Xueyao, et al.
Publicado: (2025)

SmoothSinger: A Conditional Diffusion Model for Singing Voice Synthesis with Multi-Resolution Architecture
por: Sui, Kehan, et al.
Publicado: (2025)

Voiced-Aware Style Extraction and Style Direction Adjustment for Expressive Text-to-Speech
por: Kim, Nam-Gyu
Publicado: (2025)

A Lightweight Pipeline for Noisy Speech Voice Cloning and Accurate Lip Sync Synthesis
por: Amir, Javeria, et al.
Publicado: (2025)

Empowering Global Voices: A Data-Efficient, Phoneme-Tone Adaptive Approach to High-Fidelity Speech Synthesis
por: Geng, Yizhong, et al.
Publicado: (2025)

When Tone and Words Disagree: Towards Robust Speech Emotion Recognition under Acoustic-Semantic Conflict
por: Huang, Dawei, et al.
Publicado: (2026)

UniSE: A Unified Framework for Decoder-only Autoregressive LM-based Speech Enhancement
por: Yan, Haoyin, et al.
Publicado: (2025)

SafeSpeech: Robust and Universal Voice Protection Against Malicious Speech Synthesis
por: Zhang, Zhisheng, et al.
Publicado: (2025)

RDSinger: Reference-based Diffusion Network for Singing Voice Synthesis
por: Sui, Kehan, et al.
Publicado: (2024)

Mitigating Unauthorized Speech Synthesis for Voice Protection
por: Zhang, Zhisheng, et al.
Publicado: (2024)

Voice Cloning for Dysarthric Speech Synthesis: Addressing Data Scarcity in Speech-Language Pathology
por: Moell, Birger, et al.
Publicado: (2025)

VocalParse: Towards Unified and Scalable Singing Voice Transcription with Large Audio Language Models
por: Chen, Yukun, et al.
Publicado: (2026)

Emotion-Aware Speech Generation with Character-Specific Voices for Comics
por: Qian, Zhiwen, et al.
Publicado: (2025)

DSFlow: Dual Supervision and Step-Aware Architecture for One-Step Flow Matching Speech Synthesis
por: Lin, Bin, et al.
Publicado: (2026)

YingMusic-Singer: Zero-shot Singing Voice Synthesis and Editing with Annotation-free Melody Guidance
por: Zheng, Junjie, et al.
Publicado: (2025)

Unifying Speech Recognition, Synthesis and Conversion with Autoregressive Transformers
por: Cai, Runyuan, et al.
Publicado: (2026)

MindVoice: Reconstructing Intelligible Speech from Non-invasive Neural Signals with Pretrained Priors
por: Bao, Guangyin, et al.
Publicado: (2026)

Addressing Gradient Misalignment in Data-Augmented Training for Robust Speech Deepfake Detection
por: Truong, Duc-Tuan, et al.
Publicado: (2025)

AUREXA-SE: Audio-Visual Unified Representation Exchange Architecture with Cross-Attention and Squeezeformer for Speech Enhancement
por: Sajid, M., et al.
Publicado: (2025)

QAMO: Quality-aware Multi-centroid One-class Learning For Speech Deepfake Detection
por: Truong, Duc-Tuan, et al.
Publicado: (2025)

CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Models
por: Du, Zhihao, et al.
Publicado: (2024)

Fairness-Aware Partial-label Domain Adaptation for Voice Classification of Parkinson's and ALS
por: Francesconi, Arianna, et al.
Publicado: (2026)

Large Speech Model Enabled Semantic Communication
por: Tian, Yun, et al.
Publicado: (2025)

An Agent-Based Framework for Automated Higher-Voice Harmony Generation
por: Ganapathy, Nia D'Souza, et al.
Publicado: (2025)

LAPS-Diff: A Diffusion-Based Framework for Singing Voice Synthesis With Language Aware Prosody-Style Guided Learning
por: Dhar, Sandipan, et al.
Publicado: (2025)

Unifying EEG and Speech for Emotion Recognition: A Two-Step Joint Learning Framework for Handling Missing EEG Data During Inference
por: Tiwari, Upasana, et al.
Publicado: (2025)

Speaker Verification with Speech-Aware LLMs: Evaluation and Augmentation
por: Thebaud, Thomas, et al.
Publicado: (2026)

Accelerating Autoregressive Speech Synthesis Inference With Speech Speculative Decoding
por: Lin, Zijian, et al.
Publicado: (2025)

Speech-Audio Compositional Attacks on Multimodal LLMs and Their Mitigation with SALMONN-Guard
por: Yang, Yudong, et al.
Publicado: (2025)

DMOSpeech: Direct Metric Optimization via Distilled Diffusion Model in Zero-Shot Speech Synthesis
por: Li, Yingahao Aaron, et al.
Publicado: (2024)

Interpreting Pretrained Speech Models for Automatic Speech Assessment of Voice Disorders
por: Lau, Hok-Shing, et al.
Publicado: (2024)

Speech Emotion Recognition via Entropy-Aware Score Selection
por: Chua, ChenYi, et al.
Publicado: (2025)

ArVoice: A Multi-Speaker Dataset for Arabic Speech Synthesis
por: Toyin, Hawau Olamide, et al.
Publicado: (2025)

Zero-Shot Voice Conversion via Content-Aware Timbre Ensemble and Conditional Flow Matching
por: Pan, Yu, et al.
Publicado: (2024)