SEDTalker: Emotion-Aware 3D Facial Animation Using Frame-Level Speech Emotion Diarization
Fuente:
arXiv
Saved in:
| Main Authors: | Jafari, Farzaneh, Berretti, Stefano, Basu, Anup |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
JambaTalk: Speech-Driven 3D Talking Head Generation Based on Hybrid Transformer-Mamba Model
by: Jafari, Farzaneh, et al.
Published: (2024)
by: Jafari, Farzaneh, et al.
Published: (2024)
EmoVOCA: Speech-Driven Emotional 3D Talking Heads
by: Nocentini, Federico, et al.
Published: (2024)
by: Nocentini, Federico, et al.
Published: (2024)
Polyglot: Multilingual Style Preserving Speech-Driven Facial Animation
by: Nocentini, Federico, et al.
Published: (2026)
by: Nocentini, Federico, et al.
Published: (2026)
CSTalk: Correlation Supervised Speech-driven 3D Emotional Facial Animation Generation
by: Liang, Xiangyu, et al.
Published: (2024)
by: Liang, Xiangyu, et al.
Published: (2024)
FreeTalk: Emotional Topology-Free 3D Talking Heads
by: Nocentini, Federico, et al.
Published: (2026)
by: Nocentini, Federico, et al.
Published: (2026)
EmoDiffusion: Enhancing Emotional 3D Facial Animation with Latent Diffusion Models
by: Zhang, Yixuan, et al.
Published: (2025)
by: Zhang, Yixuan, et al.
Published: (2025)
ProbTalk3D: Non-Deterministic Emotion Controllable Speech-Driven 3D Facial Animation Synthesis Using VQ-VAE
by: Wu, Sichun, et al.
Published: (2024)
by: Wu, Sichun, et al.
Published: (2024)
MEDTalk: Multimodal Controlled 3D Facial Animation with Dynamic Emotions by Disentangled Embedding
by: Liu, Chang, et al.
Published: (2025)
by: Liu, Chang, et al.
Published: (2025)
ESGaussianFace: Emotional and Stylized Audio-Driven Facial Animation via 3D Gaussian Splatting
by: Ma, Chuhang, et al.
Published: (2026)
by: Ma, Chuhang, et al.
Published: (2026)
DEEPTalk: Dynamic Emotion Embedding for Probabilistic Speech-Driven 3D Face Animation
by: Kim, Jisoo, et al.
Published: (2024)
by: Kim, Jisoo, et al.
Published: (2024)
Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusion
by: Chhatre, Kiran, et al.
Published: (2023)
by: Chhatre, Kiran, et al.
Published: (2023)
Revisiting Emotions Representation for Recognition in the Wild
by: Neto, Joao Baptista Cardia, et al.
Published: (2026)
by: Neto, Joao Baptista Cardia, et al.
Published: (2026)
EmoFace: Emotion-Content Disentangled Speech-Driven 3D Talking Face Animation
by: Lin, Yihong, et al.
Published: (2024)
by: Lin, Yihong, et al.
Published: (2024)
KMTalk: Speech-Driven 3D Facial Animation with Key Motion Embedding
by: Xu, Zhihao, et al.
Published: (2024)
by: Xu, Zhihao, et al.
Published: (2024)
AffectSRNet : Facial Emotion-Aware Super-Resolution Network
by: Rizvi, Syed Sameen Ahmad, et al.
Published: (2025)
by: Rizvi, Syed Sameen Ahmad, et al.
Published: (2025)
EmoFace: Audio-driven Emotional 3D Face Animation
by: Liu, Chang, et al.
Published: (2024)
by: Liu, Chang, et al.
Published: (2024)
Expressive Speech-driven Facial Animation with controllable emotions
by: Chen, Yutong, et al.
Published: (2023)
by: Chen, Yutong, et al.
Published: (2023)
GLDiTalker: Speech-Driven 3D Facial Animation with Graph Latent Diffusion Transformer
by: Lin, Yihong, et al.
Published: (2024)
by: Lin, Yihong, et al.
Published: (2024)
AdaMesh: Personalized Facial Expressions and Head Poses for Adaptive Speech-Driven 3D Facial Animation
by: Chen, Liyang, et al.
Published: (2023)
by: Chen, Liyang, et al.
Published: (2023)
Robust Facial Reactions Generation: An Emotion-Aware Framework with Modality Compensation
by: Hu, Guanyu, et al.
Published: (2024)
by: Hu, Guanyu, et al.
Published: (2024)
DiffSpeaker: Speech-Driven 3D Facial Animation with Diffusion Transformer
by: Ma, Zhiyuan, et al.
Published: (2024)
by: Ma, Zhiyuan, et al.
Published: (2024)
Personalized Cross-Modal Emotional Correlation Learning for Speech-Preserving Facial Expression Manipulation
by: Chen, Tianshui, et al.
Published: (2026)
by: Chen, Tianshui, et al.
Published: (2026)
Diverse Code Query Learning for Speech-Driven Facial Animation
by: Gu, Chunzhi, et al.
Published: (2024)
by: Gu, Chunzhi, et al.
Published: (2024)
Occlusion Aware Student Emotion Recognition based on Facial Action Unit Detection
by: Wally, Shrouk, et al.
Published: (2023)
by: Wally, Shrouk, et al.
Published: (2023)
ESARM: 3D Emotional Speech-to-Animation via Reward Model from Automatically-Ranked Demonstrations
by: Zhang, Xulong, et al.
Published: (2024)
by: Zhang, Xulong, et al.
Published: (2024)
Generation of Complex 3D Human Motion by Temporal and Spatial Composition of Diffusion Models
by: Mandelli, Lorenzo, et al.
Published: (2024)
by: Mandelli, Lorenzo, et al.
Published: (2024)
Facial-R1: Aligning Reasoning and Recognition for Facial Emotion Analysis
by: Wu, Jiulong, et al.
Published: (2025)
by: Wu, Jiulong, et al.
Published: (2025)
EditEmoTalk: Controllable Speech-Driven 3D Facial Animation with Continuous Expression Editing
by: Jiang, Diqiong, et al.
Published: (2026)
by: Jiang, Diqiong, et al.
Published: (2026)
LSF-Animation: Label-Free Speech-Driven Facial Animation via Implicit Feature Representation
by: Lu, Xin, et al.
Published: (2025)
by: Lu, Xin, et al.
Published: (2025)
Learning Phonetic Context-Dependent Viseme for Enhancing Speech-Driven 3D Facial Animation
by: Kim, Hyung Kyu, et al.
Published: (2025)
by: Kim, Hyung Kyu, et al.
Published: (2025)
FEALLM: Advancing Facial Emotion Analysis in Multimodal Large Language Models with Emotional Synergy and Reasoning
by: Hu, Zhuozhao, et al.
Published: (2025)
by: Hu, Zhuozhao, et al.
Published: (2025)
Facial Emotion Learning with Text-Guided Multiview Fusion via Vision-Language Model for 3D/4D Facial Expression Recognition
by: Behzad, Muzammil
Published: (2025)
by: Behzad, Muzammil
Published: (2025)
Facial Emotion Recognition using Convolutional Neural Networks
by: Saravanan, Akash, et al.
Published: (2019)
by: Saravanan, Akash, et al.
Published: (2019)
Enhancing Speech-Driven 3D Facial Animation with Audio-Visual Guidance from Lip Reading Expert
by: EunGi, Han, et al.
Published: (2024)
by: EunGi, Han, et al.
Published: (2024)
MoEE: Mixture of Emotion Experts for Audio-Driven Portrait Animation
by: Liu, Huaize, et al.
Published: (2025)
by: Liu, Huaize, et al.
Published: (2025)
KSDiff: Keyframe-Augmented Speech-Aware Dual-Path Diffusion for Facial Animation
by: Lyu, Tianle, et al.
Published: (2025)
by: Lyu, Tianle, et al.
Published: (2025)
Weaknesses of Facial Emotion Recognition Systems
by: Jamróz, Aleksandra, et al.
Published: (2026)
by: Jamróz, Aleksandra, et al.
Published: (2026)
MemoryTalker: Personalized Speech-Driven 3D Facial Animation via Audio-Guided Stylization
by: Kim, Hyung Kyu, et al.
Published: (2025)
by: Kim, Hyung Kyu, et al.
Published: (2025)
MMHead: Towards Fine-grained Multi-modal 3D Facial Animation
by: Wu, Sijing, et al.
Published: (2024)
by: Wu, Sijing, et al.
Published: (2024)
AudioFace: Language-Assisted Speech-Driven Facial Animation with Multimodal Language Models
by: Zheng, Kai, et al.
Published: (2026)
by: Zheng, Kai, et al.
Published: (2026)
Similar Items
-
JambaTalk: Speech-Driven 3D Talking Head Generation Based on Hybrid Transformer-Mamba Model
by: Jafari, Farzaneh, et al.
Published: (2024) -
EmoVOCA: Speech-Driven Emotional 3D Talking Heads
by: Nocentini, Federico, et al.
Published: (2024) -
Polyglot: Multilingual Style Preserving Speech-Driven Facial Animation
by: Nocentini, Federico, et al.
Published: (2026) -
CSTalk: Correlation Supervised Speech-driven 3D Emotional Facial Animation Generation
by: Liang, Xiangyu, et al.
Published: (2024) -
FreeTalk: Emotional Topology-Free 3D Talking Heads
by: Nocentini, Federico, et al.
Published: (2026)