Cover Image

TalkingEyes: Pluralistic Speech-Driven 3D Eye Gaze Animation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhuang, Yixiang, Ma, Chunshan, Cheng, Yao, Cheng, Xuan, Liao, Jing, Lin, Juncong
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Learn2Talk: 3D Talking Face Learns from 2D Talking Face
by: Zhuang, Yixiang, et al.
Published: (2024)

Eye Gaze Tells You Where to Compute: Gaze-Driven Efficient VLMs
by: Chen, Qinyu, et al.
Published: (2025)

EmoFace: Emotion-Content Disentangled Speech-Driven 3D Talking Face Animation
by: Lin, Yihong, et al.
Published: (2024)

Learning Unsupervised Gaze Representation via Eye Mask Driven Information Bottleneck
by: Jiang, Yangzhou, et al.
Published: (2024)

DNPM: A Neural Parametric Model for the Synthesis of Facial Geometric Details
by: Cao, Haitao, et al.
Published: (2024)

CapTalk: Text-Guided Stylization and Speech-Driven 3D Head Animation
by: Chu, Xuangeng, et al.
Published: (2026)

Roll Your Eyes: Gaze Redirection via Explicit 3D Eyeball Rotation
by: Choi, YoungChan, et al.
Published: (2025)

GazePrior: Zero-Shot AR/VR Eye Tracking via Learned 3D Gaze Reconstruction
by: Dumery, Corentin, et al.
Published: (2026)

Eye Motion Matters for 3D Face Reconstruction
by: Wang, Xuan, et al.
Published: (2024)

TalkLoRA: Low-Rank Adaptation for Speech-Driven Animation
by: Saunders, Jack, et al.
Published: (2024)

PTalker: Personalized Speech-Driven 3D Talking Head Animation via Style Disentanglement and Modality Alignment
by: Wang, Bin, et al.
Published: (2025)

EditEmoTalk: Controllable Speech-Driven 3D Facial Animation with Continuous Expression Editing
by: Jiang, Diqiong, et al.
Published: (2026)

Learning Disentangled Speech- and Expression-Driven Blendshapes for 3D Talking Face Animation
by: Mao, Yuxiang, et al.
Published: (2025)

Eyes on VLM: Benchmarking Gaze Following and Social Gaze Prediction in Vision Language Models
by: Wang, Hengfei, et al.
Published: (2026)

Towards Unsupervised Eye-Region Segmentation for Eye Tracking
by: Deng, Jiangfan, et al.
Published: (2024)

OT-Talk: Animating 3D Talking Head with Optimal Transportation
by: Wang, Xinmu, et al.
Published: (2025)

Robust Iris Centre Localisation for Assistive Eye-Gaze Tracking
by: Pathiranage, Nipun Sandamal Ranasekara, et al.
Published: (2024)

In the Eye of Transformer: Global-Local Correlation for Egocentric Gaze Estimation
by: Lai, Bolin, et al.
Published: (2022)

EgoCampus: Egocentric Pedestrian Eye Gaze Model and Dataset
by: John, Ronan, et al.
Published: (2025)

DiffPoseTalk: Speech-Driven Stylistic 3D Facial Animation and Head Pose Generation via Diffusion Models
by: Sun, Zhiyao, et al.
Published: (2023)

FAPNet: An Effective Frequency Adaptive Point-based Eye Tracker
by: Lin, Xiaopeng, et al.
Published: (2024)

Gazing Into Missteps: Leveraging Eye-Gaze for Unsupervised Mistake Detection in Egocentric Videos of Skilled Human Activities
by: Mazzamuto, Michele, et al.
Published: (2024)

DHECA-SuperGaze: Dual Head-Eye Cross-Attention and Super-Resolution for Unconstrained Gaze Estimation
by: Šikić, Franko, et al.
Published: (2025)

VERM: Leveraging Foundation Models to Create a Virtual Eye for Efficient 3D Robotic Manipulation
by: Chen, Yixiang, et al.
Published: (2025)

Seeing Without Eyes: 4D Human-Scene Understanding from Wearable IMUs
by: Hsu, Hao-Yu, et al.
Published: (2026)

Supporting Mitosis Detection AI Training with Inter-Observer Eye-Gaze Consistencies
by: Gu, Hongyan, et al.
Published: (2024)

In the Eye of MLLM: Benchmarking Egocentric Video Intent Understanding with Gaze-Guided Prompting
by: Peng, Taiying, et al.
Published: (2025)

Seeing Eye to AI: Comparing Human Gaze and Model Attention in Video Memorability
by: Kumar, Prajneya, et al.
Published: (2023)

Exploring Temporal Dynamics in Event-based Eye Tracker
by: Ren, Hongwei, et al.
Published: (2025)

SyncAnimation: A Real-Time End-to-End Framework for Audio-Driven Human Pose and Talking Head Animation
by: Liu, Yujian, et al.
Published: (2025)

CogPortrait: Fine-Grained Eye-Region Control in Portrait Animation via Hierarchical Agent Planning
by: Feng, He, et al.
Published: (2026)

Pose2Gaze: Eye-body Coordination during Daily Activities for Gaze Prediction from Full-body Poses
by: Hu, Zhiming, et al.
Published: (2023)

Eyes on Target: Gaze-Aware Object Detection in Egocentric Video
by: Lall, Vishakha, et al.
Published: (2025)

Cafe-Talk: Generating 3D Talking Face Animation with Multimodal Coarse- and Fine-grained Control
by: Chen, Hejia, et al.
Published: (2025)

EmoVOCA: Speech-Driven Emotional 3D Talking Heads
by: Nocentini, Federico, et al.
Published: (2024)

ProbTalk3D: Non-Deterministic Emotion Controllable Speech-Driven 3D Facial Animation Synthesis Using VQ-VAE
by: Wu, Sichun, et al.
Published: (2024)

Eyes Tell the Truth: GazeVal Highlights Shortcomings of Generative AI in Medical Imaging
by: Wong, David, et al.
Published: (2025)

KMTalk: Speech-Driven 3D Facial Animation with Key Motion Embedding
by: Xu, Zhihao, et al.
Published: (2024)

ARTalk: Speech-Driven 3D Head Animation via Autoregressive Model
by: Chu, Xuangeng, et al.
Published: (2025)

GLDiTalker: Speech-Driven 3D Facial Animation with Graph Latent Diffusion Transformer
by: Lin, Yihong, et al.
Published: (2024)