Cover Image

Seeing Eye to AI: Human Alignment via Gaze-Based Response Rewards for Large Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lopez-Cardona, Angela, Segura, Carlos, Karatzoglou, Alexandros, Abadal, Sergi, Arapakis, Ioannis
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence Computer Vision and Pattern Recognition Human-Computer Interaction
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Comparative Study of Scanpath Models in Graph-Based Visualization
by: Lopez-Cardona, Angela, et al.
Published: (2025)

OASST-ETC Dataset: Alignment Signals from Eye-tracking Analysis of LLM Responses
by: Lopez-Cardona, Angela, et al.
Published: (2025)

GazeInterpreter: Parsing Eye Gaze to Generate Eye-Body-Coordinated Narrations
by: Chang, Qing, et al.
Published: (2025)

See-Through Face Display: Enabling Gaze Communication for Any Face$\unicode{x2013}$Human or AI
by: Izumi, Kazuya, et al.
Published: (2024)

Challenging the Eye-Mind Link Hypothesis: Visualizing Gazes For Each Programming Problem
by: Lopez II, Michael T.
Published: (2025)

Seeing Eye to Eye: Enabling Cognitive Alignment Through Shared First-Person Perspective in Human-AI Collaboration
by: Teng, Zhuyu, et al.
Published: (2026)

Do Vision-Language Models See Visualizations Like Humans? Alignment in Chart Categorization
by: Gyarmati, Péter Ferenc, et al.
Published: (2025)

Gazing at Failure: Investigating Human Gaze in Response to Robot Failure in Collaborative Tasks
by: Tabatabaei, Ramtin, et al.
Published: (2025)

See Where You Read with Eye Gaze Tracking and Large Language Model
by: Yang, Sikai, et al.
Published: (2024)

EyeSpy: Inferring Eye Gaze via Side-Channel Attacks Against Foveated Rendering
by: Maynard, Paul, et al.
Published: (2026)

Human-AI Alignment of Multimodal Large Language Models with Speech-Language Pathologists in Parent-Child Interactions
by: Shi, Weiyan, et al.
Published: (2025)

Towards Attention-Aware Large Language Models: Integrating Real-Time Eye-Tracking and EEG for Adaptive AI Responses
by: Zhang, Dan
Published: (2025)

Eye Gaze as a Signal for Conveying User Attention in Contextual AI Systems
by: Wilson, Ethan, et al.
Published: (2025)

GazeTrak: Exploring Acoustic-based Eye Tracking on a Glass Frame
by: Li, Ke, et al.
Published: (2024)

Through the Expert's Eyes: Exploring Asynchronous Expert Perspectives and Gaze Visualizations in XR
by: Sayffaerth, Clara, et al.
Published: (2025)

Evaluating Eye Tracking Signal Quality with Real-time Gaze Interaction Simulation
by: Raju, Mehedi Hasan, et al.
Published: (2024)

Privatization of Synthetic Gaze: Attenuating State Signatures in Diffusion-Generated Eye Movements
by: Hasan, Kamrul, et al.
Published: (2026)

Gaze-supported Large Language Model Framework for Bi-directional Human-Robot Interaction
by: Rüppel, Jens V., et al.
Published: (2025)

See-Through Face Display for DHH People: Enhancing Gaze Awareness in Remote Sign Language Conversations with Camera-Behind Displays
by: Izumi, Kazuya, et al.
Published: (2025)

Eyes on Many: Evaluating Gaze, Hand, and Voice for Multi-Object Selection in Extended Reality
by: Bashar, Mohammad Raihanul, et al.
Published: (2026)

See What I Mean? Mobile Eye-Perspective Rendering for Optical See-through Head-mounted Displays
by: Emsenhuber, Gerlinde, et al.
Published: (2025)

GazeGPT: Augmenting Human Capabilities using Gaze-contingent Contextual AI for Smart Eyewear
by: Konrad, Robert, et al.
Published: (2024)

An Eye Gaze Heatmap Analysis of Uncertainty Head-Up Display Designs for Conditional Automated Driving
by: Gerber, Michael A., et al.
Published: (2024)

Gaze-Based Intention Recognition for Human-Robot Collaboration
by: Belcamino, Valerio, et al.
Published: (2024)

RaycastGrasp: Eye-Gaze Interaction with Wearable Devices for Robotic Manipulation
by: Lin, Zitiantao, et al.
Published: (2025)

As Far as Eye See: Vergence-Pupil Coupling in Near-Far Depth Switching
by: Maquiling, Virmarie, et al.
Published: (2026)

How Deep Is Your Gaze? Leveraging Distance in Image-Based Gaze Analysis
by: Koch, Maurice, et al.
Published: (2024)

Alignment, Exploration, and Novelty in Human-AI Interaction
by: Fundal, Halfdan Nordahl, et al.
Published: (2025)

Deep Learning-Based Visual Fatigue Detection Using Eye Gaze Patterns in VR
by: Zafar, Numan, et al.
Published: (2025)

Building Intelligent User Interfaces for Human-AI Alignment
by: Shi, Danqing
Published: (2026)

Effects of Personality- and Opinion-Alignment in Human-AI Interaction
by: Eder, Maximilian, et al.
Published: (2025)

Seeing Eye to AI? Applying Deep-Feature-Based Similarity Metrics to Information Visualization
by: Long, Sheng, et al.
Published: (2025)

Human vs. AI Safety Perception? Decoding Human Safety Perception with Eye-Tracking Systems, Street View Images, and Explainable AI
by: Kang, Yuhao, et al.
Published: (2025)

NeuroGaze: A Hybrid EEG and Eye-Tracking Brain-Computer Interface for Hands-Free Interaction in Virtual Reality
by: Coutray, Kyle, et al.
Published: (2025)

Focus on the Experts: Co-designing an Augmented Reality Eye-Gaze Tracking System with Surgical Trainees to Improve Endoscopic Instruction
by: Atoum, Jumanh, et al.
Published: (2025)

Which Experimental Design is Better Suited for VQA Tasks? Eye Tracking Study on Cognitive Load, Performance, and Gaze Allocations
by: Vriend, Sita A., et al.
Published: (2024)

From Seeing it to Experiencing it: Interactive Evaluation of Intersectional Voice Bias in Human-AI Speech Interaction
by: Satish, Shree Harsha Bokkahalli, et al.
Published: (2026)

"See What I Imagine, Imagine What I See": Human-AI Co-Creation System for 360$^\circ$ Panoramic Video Generation in VR
by: Wen, Yunge
Published: (2025)

Evaluating Sensitivity Parameters in Smartphone-Based Gaze Estimation: A Comparative Study of Appearance-Based and Infrared Eye Trackers
by: Gunawardena, Nishan, et al.
Published: (2025)

Towards Gaze-Informed AI Disclosure Interfaces: Eye-Tracking Attentional and Cognitive Load While Reading AI-Assisted News
by: Prajod, Pooja, et al.
Published: (2026)