At a Glance to Your Fingertips: Enabling Direct Manipulation of Distant Objects Through SightWarp

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Liu, Yang, Mikkelsen, Thorbjørn, Liu, Zehai, Tian, Gengchen, Mardanbegi, Diako, Zhou, Qiushi, Gellersen, Hans, Pfeuffer, Ken
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908851477938176
author Liu, Yang
Mikkelsen, Thorbjørn
Liu, Zehai
Tian, Gengchen
Mardanbegi, Diako
Zhou, Qiushi
Gellersen, Hans
Pfeuffer, Ken
author_facet Liu, Yang
Mikkelsen, Thorbjørn
Liu, Zehai
Tian, Gengchen
Mardanbegi, Diako
Zhou, Qiushi
Gellersen, Hans
Pfeuffer, Ken
contents In 3D user interfaces, reaching out to grab and manipulate something works great until it is out of reach. Indirect techniques like gaze and pinch offer an alternative for distant interaction, but do not provide the same immediacy or proprioceptive feedback as direct gestures. To support direct gestures for faraway objects, we introduce SightWarp, an interaction technique that exploits eye-hand coordination to seamlessly summon object proxies to the user's fingertips. The idea is that after looking at a distant object, users either shift their gaze to the hand or move their hand into view-triggering the creation of a scaled near-space proxy of the object and its surrounding context. The proxy remains active until the eye-hand pattern is released. The key benefit is that users always have an option to immediately operate on the distant object through a natural, direct hand gesture. Through a user study of a 3D object docking task, we show that users can easily employ SightWarp, and that subsequent direct manipulation improves performance over gaze and pinch. Application examples illustrate its utility for 6DOF manipulation, overview-and-detail navigation, and world-in-miniature interaction. Our work contributes to expressive and flexible object interactions across near and far spaces.
format Preprint
id arxiv_https___arxiv_org_abs_2508_04821
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle At a Glance to Your Fingertips: Enabling Direct Manipulation of Distant Objects Through SightWarp
Liu, Yang
Mikkelsen, Thorbjørn
Liu, Zehai
Tian, Gengchen
Mardanbegi, Diako
Zhou, Qiushi
Gellersen, Hans
Pfeuffer, Ken
Human-Computer Interaction
In 3D user interfaces, reaching out to grab and manipulate something works great until it is out of reach. Indirect techniques like gaze and pinch offer an alternative for distant interaction, but do not provide the same immediacy or proprioceptive feedback as direct gestures. To support direct gestures for faraway objects, we introduce SightWarp, an interaction technique that exploits eye-hand coordination to seamlessly summon object proxies to the user's fingertips. The idea is that after looking at a distant object, users either shift their gaze to the hand or move their hand into view-triggering the creation of a scaled near-space proxy of the object and its surrounding context. The proxy remains active until the eye-hand pattern is released. The key benefit is that users always have an option to immediately operate on the distant object through a natural, direct hand gesture. Through a user study of a 3D object docking task, we show that users can easily employ SightWarp, and that subsequent direct manipulation improves performance over gaze and pinch. Application examples illustrate its utility for 6DOF manipulation, overview-and-detail navigation, and world-in-miniature interaction. Our work contributes to expressive and flexible object interactions across near and far spaces.
title At a Glance to Your Fingertips: Enabling Direct Manipulation of Distant Objects Through SightWarp
topic Human-Computer Interaction
url https://arxiv.org/abs/2508.04821