Objestures: Everyday Objects Meet Mid-Air Gestures for Expressive Interaction

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lyu, Zhuoyue, Kristensson, Per Ola
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910085885722624
author Lyu, Zhuoyue
Kristensson, Per Ola
author_facet Lyu, Zhuoyue
Kristensson, Per Ola
contents Everyday object-based interactions (EOIs) and mid-air gesture interactions (MAIs) have been widely explored, yet prior work on their integration often targets narrow use cases or specific technologies, leaving designers and developers with limited guidance that generalizes across diverse EOIs and MAIs. We introduce Objestures ("Obj" + "Gestures") -- five interaction types spanning EOIs and MAIs, forming a design space for expressive uni- and bimanual interaction. To evaluate the usefulness of Objestures, we conducted an exploratory user study (N=12) on basic 3D tasks (rotation and scaling), which showed performance comparable to the headset's native freehand manipulation. To understand the user experience, we conducted case studies with the same participants across three applications (Sound, Draw, and Shadow), where participants found the interactions intuitive, engaging, and expressive, and indicated interest in everyday use. We further demonstrate the potential of Objestures across diverse contexts through 30 examples, and discuss limitations and implications. https://www.zhuoyuelyu.com/objestures
format Preprint
id arxiv_https___arxiv_org_abs_2503_02973
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Objestures: Everyday Objects Meet Mid-Air Gestures for Expressive Interaction
Lyu, Zhuoyue
Kristensson, Per Ola
Human-Computer Interaction
Everyday object-based interactions (EOIs) and mid-air gesture interactions (MAIs) have been widely explored, yet prior work on their integration often targets narrow use cases or specific technologies, leaving designers and developers with limited guidance that generalizes across diverse EOIs and MAIs. We introduce Objestures ("Obj" + "Gestures") -- five interaction types spanning EOIs and MAIs, forming a design space for expressive uni- and bimanual interaction. To evaluate the usefulness of Objestures, we conducted an exploratory user study (N=12) on basic 3D tasks (rotation and scaling), which showed performance comparable to the headset's native freehand manipulation. To understand the user experience, we conducted case studies with the same participants across three applications (Sound, Draw, and Shadow), where participants found the interactions intuitive, engaging, and expressive, and indicated interest in everyday use. We further demonstrate the potential of Objestures across diverse contexts through 30 examples, and discuss limitations and implications. https://www.zhuoyuelyu.com/objestures
title Objestures: Everyday Objects Meet Mid-Air Gestures for Expressive Interaction
topic Human-Computer Interaction
url https://arxiv.org/abs/2503.02973