Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Xia, Ziyi, Huang, Xincheng, Fels, Sidney S, Xiao, Robert
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2503.01197
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910854488784896
author Xia, Ziyi
Huang, Xincheng
Fels, Sidney S
Xiao, Robert
author_facet Xia, Ziyi
Huang, Xincheng
Fels, Sidney S
Xiao, Robert
contents Sensing touch on arbitrary surfaces has long been a goal of ubiquitous computing, but often requires instrumenting the surface. Depth camera-based systems have emerged as a promising solution for minimizing instrumentation, but at the cost of high touch-down detection error rates, high touch latency, and high minimum hover distance, limiting them to basic tasks. We developed HaloTouch, a vision-based system which exploits a multipath interference effect from an off-the-shelf time-of-flight depth camera to enable fast, accurate touch interactions on general surfaces. HaloTouch achieves a 99.2% touch-down detection accuracy across various materials, with a motion-to-photon latency of 150 ms. With a brief (20s) user-specific calibration, HaloTouch supports millimeter-accurate hover sensing as well as continuous pressure sensing. We conducted a user study with 12 participants, including a typing task demonstrating text input at 26.3 AWPM. HaloTouch shows promise for more robust, dynamic touch interactions without instrumenting surfaces or adding hardware to users.
format Preprint
id arxiv_https___arxiv_org_abs_2503_01197
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle HaloTouch: Using IR Multi-path Interference to Support Touch Interactions With General Surfaces
Xia, Ziyi
Huang, Xincheng
Fels, Sidney S
Xiao, Robert
Human-Computer Interaction
Sensing touch on arbitrary surfaces has long been a goal of ubiquitous computing, but often requires instrumenting the surface. Depth camera-based systems have emerged as a promising solution for minimizing instrumentation, but at the cost of high touch-down detection error rates, high touch latency, and high minimum hover distance, limiting them to basic tasks. We developed HaloTouch, a vision-based system which exploits a multipath interference effect from an off-the-shelf time-of-flight depth camera to enable fast, accurate touch interactions on general surfaces. HaloTouch achieves a 99.2% touch-down detection accuracy across various materials, with a motion-to-photon latency of 150 ms. With a brief (20s) user-specific calibration, HaloTouch supports millimeter-accurate hover sensing as well as continuous pressure sensing. We conducted a user study with 12 participants, including a typing task demonstrating text input at 26.3 AWPM. HaloTouch shows promise for more robust, dynamic touch interactions without instrumenting surfaces or adding hardware to users.
title HaloTouch: Using IR Multi-path Interference to Support Touch Interactions With General Surfaces
topic Human-Computer Interaction
url https://arxiv.org/abs/2503.01197