Cover Image

MindEye-OmniAssist: A Gaze-Driven LLM-Enhanced Assistive Robot System for Implicit Intention Recognition and Task Execution

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Zejia, Yang, Bo, Chen, Xinxing, Shi, Weizhuang, Wang, Haoyuan, Luo, Wei, Huang, Jian
Format:	Preprint
Published:	2025
Subjects:	Robotics Human-Computer Interaction
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Gaze-Based Intention Recognition for Human-Robot Collaboration
by: Belcamino, Valerio, et al.
Published: (2024)

GazeSummary: Exploring Gaze as an Implicit Prompt for Personalization in Text-based LLM Tasks
by: Ding, Jiexin, et al.
Published: (2026)

Challenging the Eye-Mind Link Hypothesis: Visualizing Gazes For Each Programming Problem
by: Lopez II, Michael T.
Published: (2025)

GazeMind: A Gaze-Guided LLM Agent for Personalized Cognitive Load Assessment
by: Wang, Bin, et al.
Published: (2026)

GazeInterpreter: Parsing Eye Gaze to Generate Eye-Body-Coordinated Narrations
by: Chang, Qing, et al.
Published: (2025)

Enhancing Robot Assistive Behaviour with Reinforcement Learning and Theory of Mind
by: Andriella, Antonio, et al.
Published: (2024)

EyeSpy: Inferring Eye Gaze via Side-Channel Attacks Against Foveated Rendering
by: Maynard, Paul, et al.
Published: (2026)

GazeNoter: Co-Piloted AR Note-Taking via Gaze Selection of LLM Suggestions to Match Users' Intentions
by: Tsai, Hsin-Ruey, et al.
Published: (2024)

RaycastGrasp: Eye-Gaze Interaction with Wearable Devices for Robotic Manipulation
by: Lin, Zitiantao, et al.
Published: (2025)

Gazing at Failure: Investigating Human Gaze in Response to Robot Failure in Collaborative Tasks
by: Tabatabaei, Ramtin, et al.
Published: (2025)

Robot Deformable Object Manipulation via NMPC-generated Demonstrations in Deep Reinforcement Learning
by: Wang, Haoyuan, et al.
Published: (2025)

Early Detection of Human Handover Intentions in Human-Robot Collaboration: Comparing EEG, Gaze, and Hand Motion
by: Khanna, Parag, et al.
Published: (2025)

Which Experimental Design is Better Suited for VQA Tasks? Eye Tracking Study on Cognitive Load, Performance, and Gaze Allocations
by: Vriend, Sita A., et al.
Published: (2024)

Real-Time Detection of Robot Failures Using Gaze Dynamics in Collaborative Tasks
by: Tabatabaei, Ramtin, et al.
Published: (2025)

LAMS: LLM-Driven Automatic Mode Switching for Assistive Teleoperation
by: Tao, Yiran, et al.
Published: (2025)

Designing a Socially Assistive Robot to Support Older Adults with Low Vision
by: Zhou, Emily, et al.
Published: (2024)

Focused State Recognition Using EEG with Eye Movement-Assisted Annotation
by: Li, Tian-Hua, et al.
Published: (2024)

CasualGaze: Towards Modeling and Recognizing Casual Gaze Behavior for Efficient Gaze-based Object Selection
by: Shi, Yingtian, et al.
Published: (2024)

Learning Multimodal Confidence for Intention Recognition in Human-Robot Interaction
by: Zhao, Xiyuan, et al.
Published: (2024)

Mouse-Guided Gaze: Semi-Supervised Learning of Intention-Aware Representations for Reading Detection
by: Heo, Seongsil, et al.
Published: (2025)

GazeTrak: Exploring Acoustic-based Eye Tracking on a Glass Frame
by: Li, Ke, et al.
Published: (2024)

Through the Expert's Eyes: Exploring Asynchronous Expert Perspectives and Gaze Visualizations in XR
by: Sayffaerth, Clara, et al.
Published: (2025)

Evaluating Eye Tracking Signal Quality with Real-time Gaze Interaction Simulation
by: Raju, Mehedi Hasan, et al.
Published: (2024)

Privatization of Synthetic Gaze: Attenuating State Signatures in Diffusion-Generated Eye Movements
by: Hasan, Kamrul, et al.
Published: (2026)

Towards Emotion Co-regulation with LLM-powered Socially Assistive Robots: Integrating LLM Prompts and Robotic Behaviors to Support Parent-Neurodivergent Child Dyads
by: Li, Jing, et al.
Published: (2025)

Towards Probabilistic Inference of Human Motor Intentions by Assistive Mobile Robots Controlled via a Brain-Computer Interface
by: Zhou, Xiaoshan, et al.
Published: (2025)

Mind the Gaze: Improving the Usability of Dwell Input by Adapting Gaze Targets Based on Viewing Distance
by: Namnakani, Omar, et al.
Published: (2025)

Towards Gaze-Informed AI Disclosure Interfaces: Eye-Tracking Attentional and Cognitive Load While Reading AI-Assisted News
by: Prajod, Pooja, et al.
Published: (2026)

FAM-HRI: Foundation-Model Assisted Multi-Modal Human-Robot Interaction Combining Gaze and Speech
by: Lai, Yuzhi, et al.
Published: (2025)

Predicting Selection Intention in Real-Time with Bayesian-based ML Model in Unimodal Gaze Interaction
by: Jo, Taewoo, et al.
Published: (2024)

Eyes on Many: Evaluating Gaze, Hand, and Voice for Multi-Object Selection in Extended Reality
by: Bashar, Mohammad Raihanul, et al.
Published: (2026)

Gaze Prediction as a Function of Eye Movement Type and Individual Differences
by: Melnyk, Kateryna, et al.
Published: (2024)

Model Reconciliation through Explainability and Collaborative Recovery in Assistive Robotics
by: Besch, Britt, et al.
Published: (2026)

Socially Assistive Robots: A Technological Approach to Emotional Support
by: Yee, Leanne Oon Hui, et al.
Published: (2024)

Multiple Ways of Working with Users to Develop Physically Assistive Robots
by: Nanavati, Amal, et al.
Published: (2024)

Chartist: Task-driven Eye Movement Control for Chart Reading
by: Shi, Danqing, et al.
Published: (2025)

Eye-Tracking and BCI Integration for Assistive Communication in Locked-In Syndrome: Pilot Study with Healthy Participants
by: Pinto, Ana Patrícia, et al.
Published: (2025)

An Eye Gaze Heatmap Analysis of Uncertainty Head-Up Display Designs for Conditional Automated Driving
by: Gerber, Michael A., et al.
Published: (2024)

RecGaze: The First Eye Tracking and User Interaction Dataset for Carousel Interfaces
by: de Leon-Martinez, Santiago, et al.
Published: (2025)

Improving User Experience in Preference-Based Optimization of Reward Functions for Assistive Robots
by: Dennler, Nathaniel, et al.
Published: (2024)