Eyes on VLM: Benchmarking Gaze Following and Social Gaze Prediction in Vision Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wang, Hengfei, Gupta, Anshul, Vuillecard, Pierre, Odobez, Jean-Marc
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Computer Vision and Pattern Recognition
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Exploring the Zero-Shot Capabilities of Vision-Language Models for Improving Gaze Following
di: Gupta, Anshul, et al.
Pubblicazione: (2024)

A Novel Framework for Multi-Person Temporal Gaze Following and Social Gaze Prediction
di: Gupta, Anshul, et al.
Pubblicazione: (2024)

Enhancing 3D Gaze Estimation in the Wild using Weak Supervision with Gaze Following Labels
di: Vuillecard, Pierre, et al.
Pubblicazione: (2025)

TextGaze: Gaze-Controllable Face Generation with Natural Language
di: Wang, Hengfei, et al.
Pubblicazione: (2024)

VL4Gaze: Unleashing Vision-Language Models for Gaze Following
di: Wang, Shijing, et al.
Pubblicazione: (2025)

Enhancing Gaze Reasoning in Vision Foundation Models for Gaze Following
di: Wang, Shijing, et al.
Pubblicazione: (2026)

GazeVLM: A Vision-Language Model for Multi-Task Gaze Understanding
di: Mathew, Athul M., et al.
Pubblicazione: (2025)

Investigating Identity Signals in Conversational Facial Dynamics via Disentangled Expression Features
di: Chapariniya, Masoumeh, et al.
Pubblicazione: (2025)

Towards Pixel-Level Prediction for Gaze Following: Benchmark and Approach
di: Liu, Feiyang, et al.
Pubblicazione: (2024)

GaTector+: A Unified Head-free Framework for Gaze Object and Gaze Following Prediction
di: Jin, Yang, et al.
Pubblicazione: (2025)

Eye Gaze Tells You Where to Compute: Gaze-Driven Efficient VLMs
di: Chen, Qinyu, et al.
Pubblicazione: (2025)

RTGaze: Real-Time 3D-Aware Gaze Redirection from a Single Image
di: Wang, Hengfei, et al.
Pubblicazione: (2025)

ViTGaze: Gaze Following with Interaction Features in Vision Transformers
di: Song, Yuehao, et al.
Pubblicazione: (2024)

Gaze-VLM:Bridging Gaze and VLMs through Attention Regularization for Egocentric Understanding
di: Pani, Anupam, et al.
Pubblicazione: (2025)

Pose2Gaze: Eye-body Coordination during Daily Activities for Gaze Prediction from Full-body Poses
di: Hu, Zhiming, et al.
Pubblicazione: (2023)

In the Eye of MLLM: Benchmarking Egocentric Video Intent Understanding with Gaze-Guided Prompting
di: Peng, Taiying, et al.
Pubblicazione: (2025)

EgoCampus: Egocentric Pedestrian Eye Gaze Model and Dataset
di: John, Ronan, et al.
Pubblicazione: (2025)

Gazing Into Missteps: Leveraging Eye-Gaze for Unsupervised Mistake Detection in Egocentric Videos of Skilled Human Activities
di: Mazzamuto, Michele, et al.
Pubblicazione: (2024)

DHECA-SuperGaze: Dual Head-Eye Cross-Attention and Super-Resolution for Unconstrained Gaze Estimation
di: Šikić, Franko, et al.
Pubblicazione: (2025)

Gaze-Regularized Vision-Language-Action Models for Robotic Manipulation
di: Pani, Anupam, et al.
Pubblicazione: (2026)

GazeMoDiff: Gaze-guided Diffusion Model for Stochastic Human Motion Prediction
di: Yan, Haodong, et al.
Pubblicazione: (2023)

GazeProphet: Software-Only Gaze Prediction for VR Foveated Rendering
di: Ebadulla, Farhaan, et al.
Pubblicazione: (2025)

GazePrior: Zero-Shot AR/VR Eye Tracking via Learned 3D Gaze Reconstruction
di: Dumery, Corentin, et al.
Pubblicazione: (2026)

GazeDETR: Gaze Detection using Disentangled Head and Gaze Representations
di: de Belen, Ryan Anthony Jalova, et al.
Pubblicazione: (2025)

Foraging with the Eyes: Dynamics in Human Visual Gaze and Deep Predictive Modeling
di: Panchagnula, Tejaswi V.
Pubblicazione: (2025)

Multi-Modal Gaze Following in Conversational Scenarios
di: Hou, Yuqi, et al.
Pubblicazione: (2023)

TalkingEyes: Pluralistic Speech-Driven 3D Eye Gaze Animation
di: Zhuang, Yixiang, et al.
Pubblicazione: (2025)

GazeVLM: Active Vision via Internal Attention Control for Multimodal Reasoning
di: Ebouky, Brown, et al.
Pubblicazione: (2026)

LG-Gaze: Learning Geometry-aware Continuous Prompts for Language-Guided Gaze Estimation
di: Yin, Pengwei, et al.
Pubblicazione: (2024)

CLIP-Gaze: Towards General Gaze Estimation via Visual-Linguistic Model
di: Yin, Pengwei, et al.
Pubblicazione: (2024)

SIGN: A Statistically-Informed Gaze Network for Gaze Time Prediction
di: Ye, Jianping, et al.
Pubblicazione: (2025)

Robust Iris Centre Localisation for Assistive Eye-Gaze Tracking
di: Pathiranage, Nipun Sandamal Ranasekara, et al.
Pubblicazione: (2024)

In the Eye of Transformer: Global-Local Correlation for Egocentric Gaze Estimation
di: Lai, Bolin, et al.
Pubblicazione: (2022)

Seeing Eye to AI: Comparing Human Gaze and Model Attention in Video Memorability
di: Kumar, Prajneya, et al.
Pubblicazione: (2023)

CSGaze: Context-aware Social Gaze Prediction
di: Madan, Surbhi, et al.
Pubblicazione: (2025)

OmniGaze: Reward-inspired Generalizable Gaze Estimation In The Wild
di: Qu, Hongyu, et al.
Pubblicazione: (2025)

Gaze Label Alignment: Alleviating Domain Shift for Gaze Estimation
di: Zeng, Guanzhong, et al.
Pubblicazione: (2024)

SGAP-Gaze: Scene Grid Attention Based Point-of-Gaze Estimation Network for Driver Gaze
di: Sharma, Pavan Kumar, et al.
Pubblicazione: (2026)

Gaze Prediction in Virtual Reality Without Eye Tracking Using Visual and Head Motion Cues
di: Petrou, Christos, et al.
Pubblicazione: (2026)

Boosting Gaze Object Prediction via Pixel-level Supervision from Vision Foundation Model
di: Jin, Yang, et al.
Pubblicazione: (2024)