Gaze-Hand Steering for Travel and Multitasking in Virtual Environments

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zavichi, Mona, Santos, André, Moreira, Catarina, Maciel, Anderson, Jorge, Joaquim
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917974905978880
author Zavichi, Mona
Santos, André
Moreira, Catarina
Maciel, Anderson
Jorge, Joaquim
author_facet Zavichi, Mona
Santos, André
Moreira, Catarina
Maciel, Anderson
Jorge, Joaquim
contents As head-mounted displays (HMDs) with eye-tracking become increasingly accessible, the need for effective gaze-based interfaces in virtual reality (VR) grows. Traditional gaze- or hand-based navigation often limits user precision or impairs free viewing, making multitasking difficult. We present a gaze-hand steering technique that combines eye-tracking with hand-pointing: users steer only when gaze aligns with a hand-defined target, reducing unintended actions and enabling free look. Speed is controlled via either a joystick or a waist-level speed circle. We evaluated our method in a user study (N=20) across multitasking and single-task scenarios, comparing it to a similar technique. Results show that gaze-hand steering maintains performance and enhances user comfort and spatial awareness during multitasking. Our findings support the use of gaze-hand steering in gaze-dominant VR applications requiring precision and simultaneous interaction. Our method significantly improves VR navigation in gaze-dominant, multitasking-intensive applications, supporting immersion and efficient control.
format Preprint
id arxiv_https___arxiv_org_abs_2504_01906
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Gaze-Hand Steering for Travel and Multitasking in Virtual Environments
Zavichi, Mona
Santos, André
Moreira, Catarina
Maciel, Anderson
Jorge, Joaquim
Human-Computer Interaction
As head-mounted displays (HMDs) with eye-tracking become increasingly accessible, the need for effective gaze-based interfaces in virtual reality (VR) grows. Traditional gaze- or hand-based navigation often limits user precision or impairs free viewing, making multitasking difficult. We present a gaze-hand steering technique that combines eye-tracking with hand-pointing: users steer only when gaze aligns with a hand-defined target, reducing unintended actions and enabling free look. Speed is controlled via either a joystick or a waist-level speed circle. We evaluated our method in a user study (N=20) across multitasking and single-task scenarios, comparing it to a similar technique. Results show that gaze-hand steering maintains performance and enhances user comfort and spatial awareness during multitasking. Our findings support the use of gaze-hand steering in gaze-dominant VR applications requiring precision and simultaneous interaction. Our method significantly improves VR navigation in gaze-dominant, multitasking-intensive applications, supporting immersion and efficient control.
title Gaze-Hand Steering for Travel and Multitasking in Virtual Environments
topic Human-Computer Interaction
url https://arxiv.org/abs/2504.01906