Image de couverture de livre

See the Speaker: Crafting High-Resolution Talking Faces from Speech with Prior Guidance and Region Refinement

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Wang, Jinting, Wang, Jun, Cheng, Hei Victor, Liu, Li
Format:	Preprint
Publié:	2025
Sujets:	Audio and Speech Processing Artificial Intelligence Computer Vision and Pattern Recognition Sound
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

DualTalk: Dual-Speaker Interaction for 3D Talking Head Conversations
par: Peng, Ziqiao, et autres
Publié: (2025)

EmoTalker: Emotionally Editable Talking Face Generation via Diffusion Model
par: Zhang, Bingyuan, et autres
Publié: (2024)

UniCUE: Unified Recognition and Generation Framework for Chinese Cued Speech Video-to-Speech Generation
par: Wang, Jinting, et autres
Publié: (2025)

ExpGest: Expressive Speaker Generation Using Diffusion Model and Hybrid Audio-Text Guidance
par: Cheng, Yongkang, et autres
Publié: (2024)

Emotional Face-to-Speech
par: Ye, Jiaxin, et autres
Publié: (2025)

Seeing Speech and Sound: Distinguishing and Locating Audios in Visual Scenes
par: Ryu, Hyeonggon, et autres
Publié: (2025)

Face2VoiceSync: Lightweight Face-Voice Consistency for Text-Driven Talking Face Generation
par: Kang, Fang, et autres
Publié: (2025)

Faces that Speak: Jointly Synthesising Talking Face and Speech from Text
par: Jang, Youngjoon, et autres
Publié: (2024)

Text-driven Talking Face Synthesis by Reprogramming Audio-driven Models
par: Choi, Jeongsoo, et autres
Publié: (2023)

Unsupervised Single-Channel Speech Separation with a Diffusion Prior under Speaker-Embedding Guidance
par: Shi, Runwu, et autres
Publié: (2025)

Seeing Your Speech Style: A Novel Zero-Shot Identity-Disentanglement Face-based Voice Conversion
par: Rong, Yan, et autres
Publié: (2024)

Dual Audio-Centric Modality Coupling for Talking Head Generation
par: Fu, Ao, et autres
Publié: (2025)

From Faces to Voices: Learning Hierarchical Representations for High-quality Video-to-Speech
par: Kim, Ji-Hoon, et autres
Publié: (2025)

Hear Your Face: Face-based voice conversion with F0 estimation
par: Lee, Jaejun, et autres
Publié: (2024)

READ: Real-time and Efficient Asynchronous Diffusion for Audio-driven Talking Head Generation
par: Wang, Haotian, et autres
Publié: (2025)

SSAVSV: Towards Unified Model for Self-Supervised Audio-Visual Speaker Verification
par: Rajasekhar, Gnana Praveen, et autres
Publié: (2025)

Inter-Diffusion Generation Model of Speakers and Listeners for Effective Communication
par: Huang, Jinhe, et autres
Publié: (2025)

CNVSRC 2024: The Second Chinese Continuous Visual Speech Recognition Challenge
par: Liu, Zehua, et autres
Publié: (2025)

Global-Local Distillation Network-Based Audio-Visual Speaker Tracking with Incomplete Modalities
par: Li, Yidi, et autres
Publié: (2024)

Hearing and Seeing Through CLIP: A Framework for Self-Supervised Sound Source Localization
par: Park, Sooyoung, et autres
Publié: (2025)

Enhance Generation Quality of Flow Matching V2A Model via Multi-Step CoT-Like Guidance and Combined Preference Optimization
par: Zhang, Haomin, et autres
Publié: (2025)

VAPO: End-to-end Slide-Enhanced Speech Recognition with Omni-modal Large Language Models
par: Hu, Rui, et autres
Publié: (2025)

V2SFlow: Video-to-Speech Generation with Speech Decomposition and Rectified Flow
par: Choi, Jeongsoo, et autres
Publié: (2024)

ESARM: 3D Emotional Speech-to-Animation via Reward Model from Automatically-Ranked Demonstrations
par: Zhang, Xulong, et autres
Publié: (2024)

Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners
par: Xing, Yazhou, et autres
Publié: (2024)

Leveraging Large Language Models in Visual Speech Recognition: Model Scaling, Context-Aware Decoding, and Iterative Polishing
par: Liu, Zehua, et autres
Publié: (2025)

CoLM-DSR: Leveraging Neural Codec Language Modeling for Multi-Modal Dysarthric Speech Reconstruction
par: Chen, Xueyuan, et autres
Publié: (2024)

NaturalL2S: End-to-End High-quality Multispeaker Lip-to-Speech Synthesis with Differential Digital Signal Processing
par: Liang, Yifan, et autres
Publié: (2025)

Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representation
par: Kim, Minsu, et autres
Publié: (2024)

AudioGen-Omni: A Unified Multimodal Diffusion Transformer for Video-Synchronized Audio, Speech, and Song Generation
par: Wang, Le, et autres
Publié: (2025)

Robust Active Speaker Detection in Noisy Environments
par: Vasireddy, Siva Sai Nagender, et autres
Publié: (2024)

Face-voice Association in Multilingual Environments (FAME) Challenge 2024 Evaluation Plan
par: Saeed, Muhammad Saad, et autres
Publié: (2024)

Integrating Audio, Visual, and Semantic Information for Enhanced Multimodal Speaker Diarization
par: Cheng, Luyao, et autres
Publié: (2024)

Enhancing CTC-Based Visual Speech Recognition
par: Laux, Hendrik, et autres
Publié: (2024)

FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head Models
par: Aneja, Shivangi, et autres
Publié: (2023)

Input Conditioned Layer Dropping in Speech Foundation Models
par: Hannan, Abdul, et autres
Publié: (2025)

NeRF-3DTalker: Neural Radiance Field with 3D Prior Aided Audio Disentanglement for Talking Head Synthesis
par: Liu, Xiaoxing, et autres
Publié: (2025)

VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction
par: Fu, Chaoyou, et autres
Publié: (2025)

Spiking Structured State Space Model for Monaural Speech Enhancement
par: Du, Yu, et autres
Publié: (2023)

MoMuSE: Momentum Multi-modal Target Speaker Extraction for Real-time Scenarios with Impaired Visual Cues
par: Li, Junjie, et autres
Publié: (2024)