Cover Image

GazeGPT: Augmenting Human Capabilities using Gaze-contingent Contextual AI for Smart Eyewear

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Konrad, Robert, Padmanaban, Nitish, Buckmaster, J. Gabriel, Boyle, Kevin C., Wetzstein, Gordon
Format:	Preprint
Published:	2024
Subjects:	Human-Computer Interaction Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Gaze Archive: Enhancing Human Memory through Active Visual Logging on Smart Glasses
by: Ren, Haoxin, et al.
Published: (2025)

Gazing at Failure: Investigating Human Gaze in Response to Robot Failure in Collaborative Tasks
by: Tabatabaei, Ramtin, et al.
Published: (2025)

Eye Gaze as a Signal for Conveying User Attention in Contextual AI Systems
by: Wilson, Ethan, et al.
Published: (2025)

CasualGaze: Towards Modeling and Recognizing Casual Gaze Behavior for Efficient Gaze-based Object Selection
by: Shi, Yingtian, et al.
Published: (2024)

GazeMind: A Gaze-Guided LLM Agent for Personalized Cognitive Load Assessment
by: Wang, Bin, et al.
Published: (2026)

Modeling Subjective Urban Perception with Human Gaze
by: Che, Lin, et al.
Published: (2026)

How Deep Is Your Gaze? Leveraging Distance in Image-Based Gaze Analysis
by: Koch, Maurice, et al.
Published: (2024)

GazeInterpreter: Parsing Eye Gaze to Generate Eye-Body-Coordinated Narrations
by: Chang, Qing, et al.
Published: (2025)

GazeSummary: Exploring Gaze as an Implicit Prompt for Personalization in Text-based LLM Tasks
by: Ding, Jiexin, et al.
Published: (2026)

Towards Human-Robot Teaming through Augmented Reality and Gaze-Based Attention Control
by: Shleibik, Yousra, et al.
Published: (2024)

GazePrompt: Enhancing Low Vision People's Reading Experience with Gaze-Aware Augmentations
by: Wang, Ru, et al.
Published: (2024)

Advanced Gaze Analytics Dashboard
by: Jayawardena, Gavindya, et al.
Published: (2024)

GazeSwipe: Enhancing Mobile Touchscreen Reachability through Seamless Gaze and Finger-Swipe Integration
by: Cai, Zhuojiang, et al.
Published: (2025)

The People's Gaze: Co-Designing and Refining Gaze Gestures with General Users and Gaze Interaction Experts
by: Lei, Yaxiong, et al.
Published: (2026)

GazeCopilot: Evaluating Novel Gaze-Informed Prompting for AI-Supported Code Comprehension and Readability
by: Elfares, Yasmine, et al.
Published: (2025)

GEAR: Gaze-Enabled Human-Robot Collaborative Assembly
by: Shahid, Asad Ali, et al.
Published: (2025)

Gaze-Based Intention Recognition for Human-Robot Collaboration
by: Belcamino, Valerio, et al.
Published: (2024)

Gazeify Then Voiceify: Physical Object Referencing Through Gaze and Voice Interaction with Displayless Smart Glasses
by: Zhang, Zheng, et al.
Published: (2026)

Group Gaze-Sharing with Projection Displays
by: Koch, Maurice, et al.
Published: (2025)

Look and Talk: Seamless AI Assistant Interaction with Gaze-Triggered Activation
by: Qing, Zhang, et al.
Published: (2025)

From Gaze to Guidance: Interpreting and Adapting to Users' Cognitive Needs with Multimodal Gaze-Aware AI Assistants
by: Danry, Valdemar, et al.
Published: (2026)

iBall: Augmenting Basketball Videos with Gaze-moderated Embedded Visualizations
by: Zhu-Tian, Chen, et al.
Published: (2023)

GlintMarkers: Spatial Perception on XR Eyewear using Corneal Reflections
by: Lee, Seungjoo, et al.
Published: (2026)

See-Through Face Display: Enabling Gaze Communication for Any Face$\unicode{x2013}$Human or AI
by: Izumi, Kazuya, et al.
Published: (2024)

GazeNoter: Co-Piloted AR Note-Taking via Gaze Selection of LLM Suggestions to Match Users' Intentions
by: Tsai, Hsin-Ruey, et al.
Published: (2024)

Gaze3P: Gaze-Based Prediction of User-Perceived Privacy
by: Elfares, Mayar, et al.
Published: (2025)

Design Principles & Issues for Gaze and Pinch Interaction
by: Pfeuffer, Ken
Published: (2024)

AnimeGaze: Real-Time Mutual Gaze Synthesis for Anime-Style Avatars in Physical Environments via Behind-Display Camera
by: Izumi, Kazuya, et al.
Published: (2025)

The Social Gaze of LLMs: A Literature Review of Multimodal Approaches to Human Behavior Understanding
by: Liu, Zihan, et al.
Published: (2025)

GAIPAT -Dataset on Human Gaze and Actions for Intent Prediction in Assembly Tasks
by: Grand, Maxence, et al.
Published: (2025)

AI-assisted Gaze Detection for Proctoring Online Exams
by: Shih, Yong-Siang, et al.
Published: (2024)

PinchCatcher: Enabling Multi-selection for Gaze+Pinch
by: Kim, Jinwook, et al.
Published: (2025)

Gaze-Hand Steering for Travel and Multitasking in Virtual Environments
by: Zavichi, Mona, et al.
Published: (2025)

Imperceptible Gaze Guidance Through Ocularity in Virtual Reality
by: Maquiling, Virmarie, et al.
Published: (2024)

Gaze-Aware AI: Mathematical modeling of epistemic experience of the Marginalized for Human-Computer Interaction & AI Systems
by: Hatti, Omkar Suresh
Published: (2025)

DiffGaze: A Diffusion Model for Continuous Gaze Sequence Generation on 360° Images
by: Jiao, Chuhan, et al.
Published: (2024)

GazeTarget360: Towards Gaze Target Estimation in 360-Degree for Robot Perception
by: Dai, Zhuangzhuang, et al.
Published: (2025)

Gaze-informed Signatures of Trust and Collaboration in Human-Autonomy Teams
by: Ries, Anthony J., et al.
Published: (2024)

Where Do Passengers Gaze? Impact of Passengers' Personality Traits on Their Gaze Pattern Toward Pedestrians During APMV-Pedestrian Interactions with Diverse eHMIs
by: Liu, Hailong, et al.
Published: (2025)

GazePointAR: A Context-Aware Multimodal Voice Assistant for Pronoun Disambiguation in Wearable Augmented Reality
by: Lee, Jaewook, et al.
Published: (2024)