Reimagining Wearable AR Gesture Design: Physical Therapy Reasoning in Everyday Contexts

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Wu, Wei, Xu, Binyan, Kweon, Soonhyeon, Wang, Yujie, Chukoskie, Leanne, Harteveld, Casper
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911514759266304
author Wu, Wei
Xu, Binyan
Kweon, Soonhyeon
Wang, Yujie
Chukoskie, Leanne
Harteveld, Casper
author_facet Wu, Wei
Xu, Binyan
Kweon, Soonhyeon
Wang, Yujie
Chukoskie, Leanne
Harteveld, Casper
contents Lightweight augmented reality (AR) glasses are increasingly entering everyday use, extending interaction design beyond short, isolated sessions. However, most existing gesture vocabularies are inherited from VR headsets or early AR goggles. These systems tend to prioritize recognizer accuracy while overlooking fatigue, sustainability, and social legibility in daily contexts. To address this gap, we collaborated with physical therapists (PTs) to reimagine gesture design for everyday AR, drawing on their expertise in safe and sustainable movement. Through a review of 104 AR applications, we identified 15 common gesture intents and implemented an on-device gesture generator. Ten licensed physical therapists, with an average of 14.8 years of professional experience, then shaped these gesture intents through three iterative stages: unaided gesture performance, PT-guided gesture substitution, and stage-aware card sorting. This work contributes (1) a PT-informed gesture translation method, (2) the Everyday-AR Golden Ergonomic Canvas, and (3) a stage-aware social legibility framework that illustrates how gesture suitability shifts with social readability. Together, these contributions provide a recognizer-agnostic reference framework for designing sustainable and socially coherent gesture vocabularies for lightweight AR glasses.
format Preprint
id arxiv_https___arxiv_org_abs_2603_13565
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Reimagining Wearable AR Gesture Design: Physical Therapy Reasoning in Everyday Contexts
Wu, Wei
Xu, Binyan
Kweon, Soonhyeon
Wang, Yujie
Chukoskie, Leanne
Harteveld, Casper
Human-Computer Interaction
Lightweight augmented reality (AR) glasses are increasingly entering everyday use, extending interaction design beyond short, isolated sessions. However, most existing gesture vocabularies are inherited from VR headsets or early AR goggles. These systems tend to prioritize recognizer accuracy while overlooking fatigue, sustainability, and social legibility in daily contexts. To address this gap, we collaborated with physical therapists (PTs) to reimagine gesture design for everyday AR, drawing on their expertise in safe and sustainable movement. Through a review of 104 AR applications, we identified 15 common gesture intents and implemented an on-device gesture generator. Ten licensed physical therapists, with an average of 14.8 years of professional experience, then shaped these gesture intents through three iterative stages: unaided gesture performance, PT-guided gesture substitution, and stage-aware card sorting. This work contributes (1) a PT-informed gesture translation method, (2) the Everyday-AR Golden Ergonomic Canvas, and (3) a stage-aware social legibility framework that illustrates how gesture suitability shifts with social readability. Together, these contributions provide a recognizer-agnostic reference framework for designing sustainable and socially coherent gesture vocabularies for lightweight AR glasses.
title Reimagining Wearable AR Gesture Design: Physical Therapy Reasoning in Everyday Contexts
topic Human-Computer Interaction
url https://arxiv.org/abs/2603.13565