TouchFusion: Multimodal Wristband Sensing for Ubiquitous Touch Interactions

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Whitmire, Eric, Strasnick, Evan, Boldu, Roger, Sodhi, Raj, Godwin, Nathan, Ng, Shiu, Levi, Andre, Karlson, Amy, Tan, Ran, Faller, Josef, Adamey, Emrah, Li, Hanchuan, Kienzle, Wolf, Benko, Hrvoje
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910023972552704
author Whitmire, Eric
Strasnick, Evan
Boldu, Roger
Sodhi, Raj
Godwin, Nathan
Ng, Shiu
Levi, Andre
Karlson, Amy
Tan, Ran
Faller, Josef
Adamey, Emrah
Li, Hanchuan
Kienzle, Wolf
Benko, Hrvoje
author_facet Whitmire, Eric
Strasnick, Evan
Boldu, Roger
Sodhi, Raj
Godwin, Nathan
Ng, Shiu
Levi, Andre
Karlson, Amy
Tan, Ran
Faller, Josef
Adamey, Emrah
Li, Hanchuan
Kienzle, Wolf
Benko, Hrvoje
contents TouchFusion is a wristband that enables touch interactions on nearby surfaces without any additional instrumentation or computer vision. TouchFusion combines surface electromyography (sEMG), bioimpedance, inertial, and optical sensing to capture multiple facets of hand activity during touch interactions. Through a combination of early and late fusion, TouchFusion enables stateful touch detection on both environmental and body surfaces, simple surface gestures, and tracking functionality for contextually adaptive interfaces as well as basic trackpad-like interactions. We validate our approach on a dataset of 100 participants, significantly exceeding the population size of typical wearable sensing studies to capture a wider variance of wrist anatomies, skin conductivities, and behavioral patterns. We show that TouchFusion can enable several common touch interaction tasks. Using TouchFusion, a wearer can summon a trackpad on any surface, control contextually adaptive interfaces based on where they tap, or use their palm as an always-available touch surface. When paired with smart glasses or augmented reality devices, TouchFusion enables a ubiquitous, contextually adaptive interaction model.
format Preprint
id arxiv_https___arxiv_org_abs_2602_15011
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle TouchFusion: Multimodal Wristband Sensing for Ubiquitous Touch Interactions
Whitmire, Eric
Strasnick, Evan
Boldu, Roger
Sodhi, Raj
Godwin, Nathan
Ng, Shiu
Levi, Andre
Karlson, Amy
Tan, Ran
Faller, Josef
Adamey, Emrah
Li, Hanchuan
Kienzle, Wolf
Benko, Hrvoje
Human-Computer Interaction
TouchFusion is a wristband that enables touch interactions on nearby surfaces without any additional instrumentation or computer vision. TouchFusion combines surface electromyography (sEMG), bioimpedance, inertial, and optical sensing to capture multiple facets of hand activity during touch interactions. Through a combination of early and late fusion, TouchFusion enables stateful touch detection on both environmental and body surfaces, simple surface gestures, and tracking functionality for contextually adaptive interfaces as well as basic trackpad-like interactions. We validate our approach on a dataset of 100 participants, significantly exceeding the population size of typical wearable sensing studies to capture a wider variance of wrist anatomies, skin conductivities, and behavioral patterns. We show that TouchFusion can enable several common touch interaction tasks. Using TouchFusion, a wearer can summon a trackpad on any surface, control contextually adaptive interfaces based on where they tap, or use their palm as an always-available touch surface. When paired with smart glasses or augmented reality devices, TouchFusion enables a ubiquitous, contextually adaptive interaction model.
title TouchFusion: Multimodal Wristband Sensing for Ubiquitous Touch Interactions
topic Human-Computer Interaction
url https://arxiv.org/abs/2602.15011