Imagen de Portada

DiffSHEG: A Diffusion-Based Approach for Real-Time Speech-driven Holistic 3D Expression and Gesture Generation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Chen, Junming, Liu, Yunfei, Wang, Jianan, Zeng, Ailing, Li, Yu, Chen, Qifeng
Formato:	Preprint
Publicado:	2024
Materias:	Sound Artificial Intelligence Computer Vision and Pattern Recognition Graphics Audio and Speech Processing
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

DIDiffGes: Decoupled Semi-Implicit Diffusion Models for Real-time Gesture Generation from Speech
por: Cheng, Yongkang, et al.
Publicado: (2025)

NAT: Neural Acoustic Transfer for Interactive Scenes in Real Time
por: Jin, Xutong, et al.
Publicado: (2025)

Semantic Gesticulator: Semantics-Aware Co-Speech Gesture Synthesis
por: Zhang, Zeyi, et al.
Publicado: (2024)

Beat-It: Beat-Synchronized Multi-Condition 3D Dance Generation
por: Huang, Zikai, et al.
Publicado: (2024)

READ: Real-time and Efficient Asynchronous Diffusion for Audio-driven Talking Head Generation
por: Wang, Haotian, et al.
Publicado: (2025)

Combining Genre Classification and Harmonic-Percussive Features with Diffusion Models for Music-Video Generation
por: Pina, Leonardo, et al.
Publicado: (2024)

ELGAR: Expressive Cello Performance Motion Generation for Audio Rendition
por: Qiu, Zhiping, et al.
Publicado: (2025)

Listen and Move: Improving GANs Coherency in Agnostic Sound-to-Video Generation
por: Redondo, Rafael
Publicado: (2024)

DGFM: Full Body Dance Generation Driven by Music Foundation Models
por: Liu, Xinran, et al.
Publicado: (2025)

SyncViolinist: Music-Oriented Violin Motion Generation Based on Bowing and Fingering
por: Nishizawa, Hiroki, et al.
Publicado: (2024)

MATHDance: Mamba-Transformer Architecture with Uniform Tokenization for High-Quality 3D Dance Generation
por: Yang, Kaixing, et al.
Publicado: (2025)

MotionRAG-Diff: A Retrieval-Augmented Diffusion Framework for Long-Term Music-to-Dance Generation
por: Huang, Mingyang, et al.
Publicado: (2025)

RAP: Real-time Audio-driven Portrait Animation with Video Diffusion Transformer
por: Du, Fangyu, et al.
Publicado: (2025)

Text-Driven Voice Conversion via Latent State-Space Modeling
por: Li, Wen, et al.
Publicado: (2025)

Content and Style Aware Audio-Driven Facial Animation
por: Liu, Qingju, et al.
Publicado: (2024)

EnchantDance: Unveiling the Potential of Music-Driven Dance Movement
por: Han, Bo, et al.
Publicado: (2023)

SpA2V: Harnessing Spatial Auditory Cues for Audio-driven Spatially-aware Video Generation
por: Pham, Kien T., et al.
Publicado: (2025)

MusicScore: A Dataset for Music Score Modeling and Generation
por: Lin, Yuheng, et al.
Publicado: (2024)

DanceAnyWay: Synthesizing Beat-Guided 3D Dances with Randomized Temporal Contrastive Learning
por: Bhattacharya, Aneesh, et al.
Publicado: (2023)

DiM-Gestor: Co-Speech Gesture Generation with Adaptive Layer Normalization Mamba-2
por: Zhang, Fan, et al.
Publicado: (2024)

It Takes Two: Real-time Co-Speech Two-person's Interaction Generation via Reactive Auto-regressive Diffusion Model
por: Shi, Mingyi, et al.
Publicado: (2024)

Conditional GAN for Enhancing Diffusion Models in Efficient and Authentic Global Gesture Generation from Audios
por: Cheng, Yongkang, et al.
Publicado: (2024)

LLM Gesticulator: Leveraging Large Language Models for Scalable and Controllable Co-Speech Gesture Synthesis
por: Pang, Haozhou, et al.
Publicado: (2024)

Speech-driven Personalized Gesture Synthetics: Harnessing Automatic Fuzzy Feature Inference
por: Zhang, Fan, et al.
Publicado: (2024)

Meta-Learning Empowered Meta-Face: Personalized Speaking Style Adaptation for Audio-Driven 3D Talking Face Animation
por: Zhou, Xukun, et al.
Publicado: (2024)

Audio is all in one: speech-driven gesture synthetics using WavLM pre-trained model
por: Zhang, Fan, et al.
Publicado: (2023)

DiffDSR: Dysarthric Speech Reconstruction Using Latent Diffusion Model
por: Chen, Xueyuan, et al.
Publicado: (2025)

Audio-Plane: Audio Factorization Plane Gaussian Splatting for Real-Time Talking Head Synthesis
por: Shen, Shuai, et al.
Publicado: (2025)

Text-driven Talking Face Synthesis by Reprogramming Audio-driven Models
por: Choi, Jeongsoo, et al.
Publicado: (2023)

Inter-Diffusion Generation Model of Speakers and Listeners for Effective Communication
por: Huang, Jinhe, et al.
Publicado: (2025)

A Comprehensive Multi-scale Approach for Speech and Dynamics Synchrony in Talking Head Generation
por: Airale, Louis, et al.
Publicado: (2023)

MIDGET: Music Conditioned 3D Dance Generation
por: Wang, Jinwu, et al.
Publicado: (2024)

Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitives
por: Li, Ronghui, et al.
Publicado: (2024)

FürElise: Capturing and Physically Synthesizing Hand Motions of Piano Performance
por: Wang, Ruocheng, et al.
Publicado: (2024)

Gaunt coefficients for complex and real spherical harmonics with applications to spherical array processing and Ambisonics
por: Politis, Archontis
Publicado: (2024)

LAV: Audio-Driven Dynamic Visual Generation with Neural Compression and StyleGAN2
por: Jung, Jongmin, et al.
Publicado: (2025)

GCDance: Genre-Controlled Music-Driven 3D Full Body Dance Generation
por: Liu, Xinran, et al.
Publicado: (2025)

PointTalk: Audio-Driven Dynamic Lip Point Cloud for 3D Gaussian-based Talking Head Synthesis
por: Xie, Yifan, et al.
Publicado: (2024)

Audio2Face-3D: Audio-driven Realistic Facial Animation For Digital Avatars
por: NVIDIA, et al.
Publicado: (2025)

Diff-ETS: Learning a Diffusion Probabilistic Model for Electromyography-to-Speech Conversion
por: Ren, Zhao, et al.
Publicado: (2024)