A Study of Performance and Interaction Patterns in Hand and Tangible Interaction in Tabletop Mixed Reality

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Mosquera, Carlos, Elsayed, Neven, Kruijff, Ernst, Newman, Joseph, Veas, Eduardo
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915619263217664
author Mosquera, Carlos
Elsayed, Neven
Kruijff, Ernst
Newman, Joseph
Veas, Eduardo
author_facet Mosquera, Carlos
Elsayed, Neven
Kruijff, Ernst
Newman, Joseph
Veas, Eduardo
contents This paper presents a comprehensive study of virtual 3D object manipulation along 4DoF on real surfaces in mixed reality (MR), using hand-based and tangible interactions. A custom cylindrical tangible proxy leverages affordances of physical knobs and tabletop support for stable input. We evaluate both modalities across isolated tasks (2DoF translation, 1DoF rotation scaling), semicombined (3DoF translation rotation), and full 4DoF compound manipulation. We offer analyses of hand interactions, tangible interactions, and their comparison in MR tasks. For hand interactions, compound tasks required repetitive corrections, increasing completion times yet surprisingly, rotation errors were smaller in compound tasks than in rotation only tasks. Tangible interactions exhibited significantly larger errors in translation, rotation, and scaling during compound tasks compared to isolated tasks. Crucially, tangible interactions outperformed hand interactions in precision, likely due to tabletop support and constrained 4DoF design. These findings inform designers opting for hand-only interaction (highlighting tradeoffs in compound tasks) and those leveraging tangibles (emphasizing precision gains despite compound-task challenges).
format Preprint
id arxiv_https___arxiv_org_abs_2511_11962
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Study of Performance and Interaction Patterns in Hand and Tangible Interaction in Tabletop Mixed Reality
Mosquera, Carlos
Elsayed, Neven
Kruijff, Ernst
Newman, Joseph
Veas, Eduardo
Human-Computer Interaction
This paper presents a comprehensive study of virtual 3D object manipulation along 4DoF on real surfaces in mixed reality (MR), using hand-based and tangible interactions. A custom cylindrical tangible proxy leverages affordances of physical knobs and tabletop support for stable input. We evaluate both modalities across isolated tasks (2DoF translation, 1DoF rotation scaling), semicombined (3DoF translation rotation), and full 4DoF compound manipulation. We offer analyses of hand interactions, tangible interactions, and their comparison in MR tasks. For hand interactions, compound tasks required repetitive corrections, increasing completion times yet surprisingly, rotation errors were smaller in compound tasks than in rotation only tasks. Tangible interactions exhibited significantly larger errors in translation, rotation, and scaling during compound tasks compared to isolated tasks. Crucially, tangible interactions outperformed hand interactions in precision, likely due to tabletop support and constrained 4DoF design. These findings inform designers opting for hand-only interaction (highlighting tradeoffs in compound tasks) and those leveraging tangibles (emphasizing precision gains despite compound-task challenges).
title A Study of Performance and Interaction Patterns in Hand and Tangible Interaction in Tabletop Mixed Reality
topic Human-Computer Interaction
url https://arxiv.org/abs/2511.11962