The Social Gaze of LLMs: A Literature Review of Multimodal Approaches to Human Behavior Understanding

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Liu, Zihan, Rabbani, Parisa, Duddu, Veda, Fan, Kyle, Lee, Madison, Huang, Yun
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Human-Computer Interaction
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Do We Know What They Know We Know? Calibrating Student Trust in AI and Human Responses Through Mutual Theory of Mind
di: Pal, Olivia, et al.
Pubblicazione: (2026)

Human-Like Gaze Behavior in Social Robots: A Deep Learning Approach Integrating Human and Non-Human Stimuli
di: Vahedi, Faezeh, et al.
Pubblicazione: (2026)

A Review of Driver Gaze Estimation and Application in Gaze Behavior Understanding
di: Sharma, Pavan Kumar, et al.
Pubblicazione: (2023)

CasualGaze: Towards Modeling and Recognizing Casual Gaze Behavior for Efficient Gaze-based Object Selection
di: Shi, Yingtian, et al.
Pubblicazione: (2024)

IntenBot: Flexible and Imprecise Multimodal Input for LLMs to Understand User Intentions for Casual and Human-Like HRI
di: Liu, Yen-Ting, et al.
Pubblicazione: (2026)

GazeLLM: Multimodal LLMs incorporating Human Visual Attention
di: Rekimoto, Jun
Pubblicazione: (2025)

Social Life Simulation for Non-Cognitive Skills Learning
di: Yan, Zihan, et al.
Pubblicazione: (2024)

SemanticScanpath: Combining Gaze and Speech for Situated Human-Robot Interaction Using LLMs
di: Menendez, Elisabeth, et al.
Pubblicazione: (2025)

Robust Understanding of Human-Robot Social Interactions through Multimodal Distillation
di: Bian, Tongfei, et al.
Pubblicazione: (2025)

Modeling the Impact of Visual Stimuli on Redirection Noticeability with Gaze Behavior in Virtual Reality
di: Li, Zhipeng, et al.
Pubblicazione: (2025)

Systematic Literature Review of Using Virtual Reality as a Social Platform in HCI Community
di: Wei, Xiaoying, et al.
Pubblicazione: (2024)

Gaze-Enhanced Multimodal Turn-Taking Prediction in Triadic Conversations
di: Heo, Seongsil, et al.
Pubblicazione: (2025)

Gazing at Failure: Investigating Human Gaze in Response to Robot Failure in Collaborative Tasks
di: Tabatabaei, Ramtin, et al.
Pubblicazione: (2025)

Human Behavior Simulation: Objectives, Methodologies, and Open Problems
di: Guozhen, Zhang, et al.
Pubblicazione: (2024)

AppGen: Mobility-aware App Usage Behavior Generation for Mobile Users
di: Huang, Zihan, et al.
Pubblicazione: (2024)

Does AI Coaching Prepare us for Workplace Negotiations?
di: Duddu, Veda, et al.
Pubblicazione: (2025)

Not My Truce: Personality Differences in AI-Mediated Workplace Negotiation
di: Duddu, Veda, et al.
Pubblicazione: (2026)

GazePointAR: A Context-Aware Multimodal Voice Assistant for Pronoun Disambiguation in Wearable Augmented Reality
di: Lee, Jaewook, et al.
Pubblicazione: (2024)

EMINDS: Understanding User Behavior Progression for Mental Health Exploration on Social Media
di: Sheng, Rui, et al.
Pubblicazione: (2025)

From Script to Stage: Automating Experimental Design for Social Simulations with LLMs
di: Guo, Yuwei, et al.
Pubblicazione: (2025)

GazeSummary: Exploring Gaze as an Implicit Prompt for Personalization in Text-based LLM Tasks
di: Ding, Jiexin, et al.
Pubblicazione: (2026)

Simulating Human Strategic Behavior: Comparing Single and Multi-agent LLMs
di: Sreedhar, Karthik, et al.
Pubblicazione: (2024)

GEAR: Gaze-Enabled Human-Robot Collaborative Assembly
di: Shahid, Asad Ali, et al.
Pubblicazione: (2025)

Gaze-Based Intention Recognition for Human-Robot Collaboration
di: Belcamino, Valerio, et al.
Pubblicazione: (2024)

GazeMind: A Gaze-Guided LLM Agent for Personalized Cognitive Load Assessment
di: Wang, Bin, et al.
Pubblicazione: (2026)

AI Assistance for UX: A Literature Review Through Human-Centered AI
di: Lu, Yuwen, et al.
Pubblicazione: (2024)

NeuroGaze: A Hybrid EEG and Eye-Tracking Brain-Computer Interface for Hands-Free Interaction in Virtual Reality
di: Coutray, Kyle, et al.
Pubblicazione: (2025)

Understanding State Social Anxiety in Virtual Social Interactions using Multimodal Wearable Sensing Indicators
di: Larrazabal, Maria A., et al.
Pubblicazione: (2025)

AI or Human? Understanding Perceptions of Embodied Robots with LLMs
di: Hriscu, Lavinia, et al.
Pubblicazione: (2025)

Gaze Archive: Enhancing Human Memory through Active Visual Logging on Smart Glasses
di: Ren, Haoxin, et al.
Pubblicazione: (2025)

PinchCatcher: Enabling Multi-selection for Gaze+Pinch
di: Kim, Jinwook, et al.
Pubblicazione: (2025)

How Deep Is Your Gaze? Leveraging Distance in Image-Based Gaze Analysis
di: Koch, Maurice, et al.
Pubblicazione: (2024)

GazeInterpreter: Parsing Eye Gaze to Generate Eye-Body-Coordinated Narrations
di: Chang, Qing, et al.
Pubblicazione: (2025)

From Gaze to Guidance: Interpreting and Adapting to Users' Cognitive Needs with Multimodal Gaze-Aware AI Assistants
di: Danry, Valdemar, et al.
Pubblicazione: (2026)

A Comprehensive Literature Review on Sweet Orange Leaf Diseases
di: Emon, Yousuf Rayhan, et al.
Pubblicazione: (2023)

Co-persona: Leveraging LLMs and Expert Collaboration to Understand User Personas through Social Media Data Analysis
di: Yin, Min, et al.
Pubblicazione: (2025)

Toward Multimodal Privacy in XR: Design and Evaluation of Composite Privatization Methods for Gaze and Body Tracking Data
di: Ibragimov, Azim, et al.
Pubblicazione: (2025)

Predicting Selection Intention in Real-Time with Bayesian-based ML Model in Unimodal Gaze Interaction
di: Jo, Taewoo, et al.
Pubblicazione: (2024)

Alignment Drift in Multimodal LLMs: A Two-Phase, Longitudinal Evaluation of Harm Across Eight Model Releases
di: Ford, Casey, et al.
Pubblicazione: (2026)

Human Autonomy and Sense of Agency in Human-Robot Interaction: A Systematic Literature Review
di: Glawe, Felix, et al.
Pubblicazione: (2025)