Imagen de Portada

UniLS: End-to-End Audio-Driven Avatars for Unified Listening and Speaking

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Chu, Xuangeng, Liu, Ruicong, Huang, Yifei, Liu, Yun, Peng, Yichen, Zheng, Bo
Formato:	Preprint
Publicado:	2025
Materias:	Computer Vision and Pattern Recognition Sound
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

DeepAudio-V1:Towards Multi-Modal Multi-Stage End-to-End Video to Speech and Audio Generation
por: Zhang, Haomin, et al.
Publicado: (2025)

Omni-Customizer: End-to-End MultiModal Customization for Joint Audio-Video Generation
por: Chen, Yuheng, et al.
Publicado: (2026)

TurboTalk: Progressive Distillation for One-Step Audio-Driven Talking Avatar Generation
por: Liu, Xiangyu, et al.
Publicado: (2026)

UniSync: A Unified Framework for Audio-Visual Synchronization
por: Feng, Tao, et al.
Publicado: (2025)

UniTalking: A Unified Audio-Video Framework for Talking Portrait Generation
por: Li, Hebeizi, et al.
Publicado: (2026)

Semantic Audio-Visual Navigation in Continuous Environments
por: Zeng, Yichen, et al.
Publicado: (2026)

NaturalL2S: End-to-End High-quality Multispeaker Lip-to-Speech Synthesis with Differential Digital Signal Processing
por: Liang, Yifan, et al.
Publicado: (2025)

Aligned Better, Listen Better for Audio-Visual Large Language Models
por: Guo, Yuxin, et al.
Publicado: (2025)

UniAV: Unified Audio-Visual Perception for Multi-Task Video Event Localization
por: Geng, Tiantian, et al.
Publicado: (2024)

Generalizable and Animatable Gaussian Head Avatar
por: Chu, Xuangeng, et al.
Publicado: (2024)

JavisDiT++: Unified Modeling and Optimization for Joint Audio-Video Generation
por: Liu, Kai, et al.
Publicado: (2026)

GaussianSpeech: Audio-Driven Gaussian Avatars
por: Aneja, Shivangi, et al.
Publicado: (2024)

EMO2: End-Effector Guided Audio-Driven Avatar Video Generation
por: Tian, Linrui, et al.
Publicado: (2025)

When Vision Speaks for Sound
por: Wen, Xiaofei, et al.
Publicado: (2026)

REST: Diffusion-based Real-time End-to-end Streaming Talking Head Generation via ID-Context Caching and Asynchronous Streaming Distillation
por: Wang, Haotian, et al.
Publicado: (2025)

UMo: Unified Sparse Motion Modeling for Real-Time Co-Speech Avatars
por: Zhan, Xiaoyu, et al.
Publicado: (2026)

Look, Listen and Recognise: Character-Aware Audio-Visual Subtitling
por: Korbar, Bruno, et al.
Publicado: (2024)

WAVE: Learning Unified & Versatile Audio-Visual Embeddings with Multimodal LLM
por: Tang, Changli, et al.
Publicado: (2025)

Distillation-based Layer Dropping (DLD): Effective End-to-end Framework for Dynamic Speech Networks
por: Hannan, Abdul, et al.
Publicado: (2026)

ANIM-400K: A Large-Scale Dataset for Automated End-To-End Dubbing of Video
por: Cai, Kevin, et al.
Publicado: (2024)

Sheet Music Transformer: End-To-End Optical Music Recognition Beyond Monophonic Transcription
por: Ríos-Vila, Antonio, et al.
Publicado: (2024)

Robust Audio-Visual Segmentation via Audio-Guided Visual Convergent Alignment
por: Liu, Chen, et al.
Publicado: (2025)

ControlFoley: Unified and Controllable Video-to-Audio Generation with Cross-Modal Conflict Handling
por: Yang, Jianxuan, et al.
Publicado: (2026)

Speech Audio Generation from dynamic MRI via a Knowledge Enhanced Conditional Variational Autoencoder
por: Li, Yaxuan, et al.
Publicado: (2025)

UniCUE: Unified Recognition and Generation Framework for Chinese Cued Speech Video-to-Speech Generation
por: Wang, Jinting, et al.
Publicado: (2025)

CustomListener: Text-guided Responsive Interaction for User-friendly Listening Head Generation
por: Liu, Xi, et al.
Publicado: (2024)

Hallo-Live: Real-Time Streaming Joint Audio-Video Avatar Generation with Asynchronous Dual-Stream and Human-Centric Preference Distillation
por: Li, Chunyu, et al.
Publicado: (2026)

End-to-end Audio Deepfake Detection from RAW Waveforms: a RawNet-Based Approach with Cross-Dataset Evaluation
por: Di Pierno, Andrea, et al.
Publicado: (2025)

Omni2Sound: Towards Unified Video-Text-to-Audio Generation
por: Dai, Yusheng, et al.
Publicado: (2026)

UniForm: A Unified Multi-Task Diffusion Transformer for Audio-Video Generation
por: Zhao, Lei, et al.
Publicado: (2025)

WavFlow: Audio Generation in Waveform Space
por: Zhou, Feiyan, et al.
Publicado: (2026)

Bootstrapping Audio-Visual Segmentation by Strengthening Audio Cues
por: Chen, Tianxiang, et al.
Publicado: (2024)

VAPO: End-to-end Slide-Enhanced Speech Recognition with Omni-modal Large Language Models
por: Hu, Rui, et al.
Publicado: (2025)

Mutual Forcing: Dual-Mode Self-Evolution for Fast Autoregressive Audio-Video Character Generation
por: Zhou, Yupeng, et al.
Publicado: (2026)

MIRRORTALK: Forging Personalized Avatars Via Disentangled Style and Hierarchical Motion Control
por: Lu, Renjie, et al.
Publicado: (2026)

TCDiff++: An End-to-end Trajectory-Controllable Diffusion Model for Harmonious Music-Driven Group Choreography
por: Dai, Yuqin, et al.
Publicado: (2025)

MOVA: Towards Scalable and Synchronized Video-Audio Generation
por: OpenMOSS Team, et al.
Publicado: (2026)

VABench: A Comprehensive Benchmark for Audio-Video Generation
por: Hua, Daili, et al.
Publicado: (2025)

FlowPortrait: Reinforcement Learning for Audio-Driven Portrait Video Generation
por: Tan, Weiting, et al.
Publicado: (2026)

UniUncer: Unified Dynamic Static Uncertainty for End to End Driving
por: Gao, Yu, et al.
Publicado: (2026)