Cover Image

From Gaze to Guidance: Interpreting and Adapting to Users' Cognitive Needs with Multimodal Gaze-Aware AI Assistants

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Danry, Valdemar, Hernandez, Javier, Wilson, Andrew, Maes, Pattie, Amores, Judith
Format:	Preprint
Published:	2026
Subjects:	Human-Computer Interaction Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Critical Inker: Scaffolding Critical Thinking in AI-Assisted Writing Through Socratic Questioning
by: Hugenroth, Philipp, et al.
Published: (2026)

Can dialogues with AI systems help humans better discern visual misinformation?
by: Rani, Anku, et al.
Published: (2025)

Super-intelligence or Superstition? Exploring Psychological Factors Influencing Belief in AI Predictions about Personal Behavior
by: Lee, Eunhae, et al.
Published: (2024)

Dialogues with AI Reduce Beliefs in Misinformation but Build No Lasting Discernment Skills
by: Rani, Anku, et al.
Published: (2025)

Feeling the Facts: Real-time Wearable Fact-checkers Can Use Nudges to Reduce User Belief in False Information
by: Gupta, Chitralekha, et al.
Published: (2026)

PhysioLLM: Supporting Personalized Health Insights with Wearables and Large Language Models
by: Fang, Cathy Mengying, et al.
Published: (2024)

AI persuading AI vs AI persuading Humans: LLMs' Differential Effectiveness in Promoting Pro-Environmental Behavior
by: Doudkin, Alexander, et al.
Published: (2025)

OceanChat: The Effect of Virtual Conversational AI Agents on Sustainable Attitude and Behavior Change
by: Pataranutaporn, Pat, et al.
Published: (2025)

Investigating Affective Use and Emotional Well-being on ChatGPT
by: Phang, Jason, et al.
Published: (2025)

When Peers Outperform AI (and When They Don't): Interaction Quality Over Modality
by: Morris, Caitlin, et al.
Published: (2026)

Same Feedback, Different Source: How AI vs. Human Feedback Shapes Learner Engagement
by: Morris, Caitlin, et al.
Published: (2026)

Same Feedback, Different Source: How AI vs. Human Feedback Attribution and Credibility Shape Learner Behavior in Computing Education
by: Morris, Caitlin, et al.
Published: (2026)

Designing Gaze Analytics for ELA Instruction: A User-Centered Dashboard with Conversational AI Support
by: Davalos, Eduardo, et al.
Published: (2025)

Look and Talk: Seamless AI Assistant Interaction with Gaze-Triggered Activation
by: Qing, Zhang, et al.
Published: (2025)

AI-assisted Gaze Detection for Proctoring Online Exams
by: Shih, Yong-Siang, et al.
Published: (2024)

Gaze-Aware AI: Mathematical modeling of epistemic experience of the Marginalized for Human-Computer Interaction & AI Systems
by: Hatti, Omkar Suresh
Published: (2025)

GazePointAR: A Context-Aware Multimodal Voice Assistant for Pronoun Disambiguation in Wearable Augmented Reality
by: Lee, Jaewook, et al.
Published: (2024)

GazeInterpreter: Parsing Eye Gaze to Generate Eye-Body-Coordinated Narrations
by: Chang, Qing, et al.
Published: (2025)

AI-rays: Exploring Bias in the Gaze of AI Through a Multimodal Interactive Installation
by: Gao, Ziyao, et al.
Published: (2024)

Resonance: Drawing from Memories to Imagine Positive Futures through AI-Augmented Journaling
by: Zulfikar, Wazeer, et al.
Published: (2025)

The People's Gaze: Co-Designing and Refining Gaze Gestures with General Users and Gaze Interaction Experts
by: Lei, Yaxiong, et al.
Published: (2026)

Storycaster: An AI System for Immersive Room-Based Storytelling
by: Agarwal, Naisha, et al.
Published: (2025)

GazeMind: A Gaze-Guided LLM Agent for Personalized Cognitive Load Assessment
by: Wang, Bin, et al.
Published: (2026)

Towards Gaze-Informed AI Disclosure Interfaces: Eye-Tracking Attentional and Cognitive Load While Reading AI-Assisted News
by: Prajod, Pooja, et al.
Published: (2026)

SENSE-7: Taxonomy and Dataset for Measuring User Perceptions of Empathy in Sustained Human-AI Conversations
by: Suh, Jina, et al.
Published: (2025)

How AI and Human Behaviors Shape Psychosocial Effects of Extended Chatbot Use: A Longitudinal Randomized Controlled Study
by: Fang, Cathy Mengying, et al.
Published: (2025)

Imperceptible Gaze Guidance Through Ocularity in Virtual Reality
by: Maquiling, Virmarie, et al.
Published: (2024)

Exploring the Impact of AI Value Alignment in Collaborative Ideation: Effects on Perception, Ownership, and Output
by: Guo, Alicia, et al.
Published: (2024)

Gaze3P: Gaze-Based Prediction of User-Perceived Privacy
by: Elfares, Mayar, et al.
Published: (2025)

Synthetic Human Memories: AI-Edited Images and Videos Can Implant False Memories and Distort Recollection
by: Pataranutaporn, Pat, et al.
Published: (2024)

Chatbot Companionship: A Mixed-Methods Study of Companion Chatbot Usage Patterns and Their Relationship to Loneliness in Active Users
by: Liu, Auren R., et al.
Published: (2024)

Multimodal Learning and Cognitive Processes in Radiology: MedGaze for Chest X-ray Scanpath Prediction
by: Awasthi, Akash, et al.
Published: (2024)

Mind the Gaze: Improving the Usability of Dwell Input by Adapting Gaze Targets Based on Viewing Distance
by: Namnakani, Omar, et al.
Published: (2025)

CasualGaze: Towards Modeling and Recognizing Casual Gaze Behavior for Efficient Gaze-based Object Selection
by: Shi, Yingtian, et al.
Published: (2024)

Future You: Designing and Evaluating Multimodal AI-generated Digital Twins for Strengthening Future Self-Continuity
by: Albrecht, Constanze, et al.
Published: (2025)

GazeNoter: Co-Piloted AR Note-Taking via Gaze Selection of LLM Suggestions to Match Users' Intentions
by: Tsai, Hsin-Ruey, et al.
Published: (2024)

AdaptLIL: A Gaze-Adaptive Visualization for Ontology Mapping
by: Chow, Nicholas, et al.
Published: (2024)

G-VOILA: Gaze-Facilitated Information Querying in Daily Scenarios
by: Wang, Zeyu, et al.
Published: (2024)

NeuGaze: Reshaping the future BCI
by: Yang, Yiqian
Published: (2025)

VoiceMorph: How AI Voice Morphing Reveals the Boundaries of Auditory Self-Recognition
by: Shimizu, Kye, et al.
Published: (2025)