Image de couverture de livre

A Bridge from Audio to Video: Phoneme-Viseme Alignment Allows Every Face to Speak Multiple Languages

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Su, Zibo, Wei, Kun, Li, Jiahua, Yang, Xu, Deng, Cheng
Format:	Preprint
Publié:	2025
Sujets:	Computer Vision and Pattern Recognition
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Perceive, Verify and Understand Long Video: Multi-Granular Perception and Active Verification via Interactive Agents
par: Li, Jiahua, et autres
Publié: (2025)

Does YOLO Really Need to See Every Training Image in Every Epoch?
par: Xie, Xingxing, et autres
Publié: (2026)

Text2Lip: Progressive Lip-Synced Talking Face Generation from Text via Viseme-Guided Rendering
par: Wang, Xu, et autres
Publié: (2025)

LipGen: Viseme-Guided Lip Video Generation for Enhancing Visual Speech Recognition
par: Hao, Bowen, et autres
Publié: (2025)

Do You Guys Want to Dance: Zero-Shot Compositional Human Dance Generation with Multiple Persons
par: Xu, Zhe, et autres
Publié: (2024)

Don't Let the Video Speak: Audio-Contrastive Preference Optimization for Audio-Visual Language Models
par: Baid, Ami, et autres
Publié: (2026)

ViSpeak: Visual Instruction Feedback in Streaming Videos
par: Fu, Shenghao, et autres
Publié: (2025)

Omni-Emotion: Extending Video MLLM with Detailed Face and Audio Modeling for Multimodal Emotion Analysis
par: Yang, Qize, et autres
Publié: (2025)

Video-Language Alignment via Spatio-Temporal Graph Transformer
par: Zhang, Shi-Xue, et autres
Publié: (2024)

PivotMerge: Bridging Heterogeneous Multimodal Pre-training via Post-Alignment Model Merging
par: Shao, Zibo, et autres
Publié: (2026)

Video-to-Audio Generation with Hidden Alignment
par: Xu, Manjie, et autres
Publié: (2024)

Hierarchical Dual-Subspace Decoupling for Continual Learning in Vision-Language Models
par: Qin, Mengxin, et autres
Publié: (2026)

SkyReels-Audio: Omni Audio-Conditioned Talking Portraits in Video Diffusion Transformers
par: Fei, Zhengcong, et autres
Publié: (2025)

ViLA: Efficient Video-Language Alignment for Video Question Answering
par: Wang, Xijun, et autres
Publié: (2023)

Real Face Video Animation Platform
par: Chen, Xiaokai, et autres
Publié: (2024)

FaceChain-ImagineID: Freely Crafting High-Fidelity Diverse Talking Faces from Disentangled Audio
par: Xu, Chao, et autres
Publié: (2024)

SMRABooth: Subject and Motion Representation Alignment for Customized Video Generation
par: Xu, Xuancheng, et autres
Publié: (2025)

Mitigating Knowledge Discrepancies among Multiple Datasets for Task-agnostic Unified Face Alignment
par: Xia, Jiahao, et autres
Publié: (2025)

Analyzing Image Beyond Visual Aspect: Image Emotion Classification via Multiple-Affective Captioning
par: Zhou, Zibo, et autres
Publié: (2025)

Learning to Trim: End-to-End Causal Graph Pruning with Dynamic Anatomical Feature Banks for Medical VQA
par: Xu, Zibo, et autres
Publié: (2026)

JoyGen: Audio-Driven 3D Depth-Aware Talking-Face Video Editing
par: Wang, Qili, et autres
Publié: (2025)

DH-FaceVid-1K: A Large-Scale High-Quality Dataset for Face Video Generation
par: Di, Donglin, et autres
Publié: (2024)

AudioFace: Language-Assisted Speech-Driven Facial Animation with Multimodal Language Models
par: Zheng, Kai, et autres
Publié: (2026)

Mamba-Enhanced Text-Audio-Video Alignment Network for Emotion Recognition in Conversations
par: Li, Xinran, et autres
Publié: (2024)

DIMoE-Adapters: Dynamic Expert Evolution for Continual Learning in Vision-Language Models
par: Qin, Mengxin, et autres
Publié: (2026)

Optimizing Vision-Language Consistency via Cross-Layer Regional Attention Alignment
par: Wang, Yifan, et autres
Publié: (2025)

Native Audio-Visual Alignment for Generation
par: Ji, Longbin, et autres
Publié: (2026)

iKUN: Speak to Trackers without Retraining
par: Du, Yunhao, et autres
Publié: (2023)

Beyond Global Alignment: Fine-Grained Motion-Language Retrieval via Pyramidal Shapley-Taylor Learning
par: Chen, Hanmo, et autres
Publié: (2026)

Unsupervised Audio-Visual Segmentation with Modality Alignment
par: Bhosale, Swapnil, et autres
Publié: (2024)

Teacher-Guided Pseudo Supervision and Cross-Modal Alignment for Audio-Visual Video Parsing
par: Chen, Yaru, et autres
Publié: (2025)

Making Every Frame Matter: Continuous Activity Recognition in Streaming Video via Adaptive Video Context Modeling
par: Wu, Hao, et autres
Publié: (2024)

DreamID-V:Bridging the Image-to-Video Gap for High-Fidelity Face Swapping via Diffusion Transformer
par: Guo, Xu, et autres
Publié: (2026)

HiFiVFS: High Fidelity Video Face Swapping
par: Chen, Xu, et autres
Publié: (2024)

Audio-Visual Speech Representation Expert for Enhanced Talking Face Video Generation and Evaluation
par: Yaman, Dogucan, et autres
Publié: (2024)

You Only Speak Once to See
par: Yang, Wenhao, et autres
Publié: (2024)

Enhancing Partially Relevant Video Retrieval with Robust Alignment Learning
par: Zhang, Long, et autres
Publié: (2025)

Impact of Face Alignment on Face Image Quality
par: Onaran, Eren, et autres
Publié: (2024)

DynamicFace: High-Quality and Consistent Face Swapping for Image and Video using Composable 3D Facial Priors
par: Wang, Runqi, et autres
Publié: (2025)

VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Time
par: Xu, Sicheng, et autres
Publié: (2024)