STAR: Smartphone-analogous Typing in Augmented Reality

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kim, Taejun, Karlson, Amy, Gupta, Aakar, Grossman, Tovi, Wu, Jason, Abtahi, Parastoo, Collins, Christopher, Glueck, Michael, Surale, Hemant Bhaskar
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918218406297600
author Kim, Taejun
Karlson, Amy
Gupta, Aakar
Grossman, Tovi
Wu, Jason
Abtahi, Parastoo
Collins, Christopher
Glueck, Michael
Surale, Hemant Bhaskar
author_facet Kim, Taejun
Karlson, Amy
Gupta, Aakar
Grossman, Tovi
Wu, Jason
Abtahi, Parastoo
Collins, Christopher
Glueck, Michael
Surale, Hemant Bhaskar
contents While text entry is an essential and frequent task in Augmented Reality (AR) applications, devising an efficient and easy-to-use text entry method for AR remains an open challenge. This research presents STAR, a smartphone-analogous AR text entry technique that leverages a user's familiarity with smartphone two-thumb typing. With STAR, a user performs thumb typing on a virtual QWERTY keyboard that is overlain on the skin of their hands. During an evaluation study of STAR, participants achieved a mean typing speed of 21.9 WPM (i.e., 56% of their smartphone typing speed), and a mean error rate of 0.3% after 30 minutes of practice. We further analyze the major factors implicated in the performance gap between STAR and smartphone typing, and discuss ways this gap could be narrowed.
format Preprint
id arxiv_https___arxiv_org_abs_2511_21143
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle STAR: Smartphone-analogous Typing in Augmented Reality
Kim, Taejun
Karlson, Amy
Gupta, Aakar
Grossman, Tovi
Wu, Jason
Abtahi, Parastoo
Collins, Christopher
Glueck, Michael
Surale, Hemant Bhaskar
Human-Computer Interaction
Computer Vision and Pattern Recognition
While text entry is an essential and frequent task in Augmented Reality (AR) applications, devising an efficient and easy-to-use text entry method for AR remains an open challenge. This research presents STAR, a smartphone-analogous AR text entry technique that leverages a user's familiarity with smartphone two-thumb typing. With STAR, a user performs thumb typing on a virtual QWERTY keyboard that is overlain on the skin of their hands. During an evaluation study of STAR, participants achieved a mean typing speed of 21.9 WPM (i.e., 56% of their smartphone typing speed), and a mean error rate of 0.3% after 30 minutes of practice. We further analyze the major factors implicated in the performance gap between STAR and smartphone typing, and discuss ways this gap could be narrowed.
title STAR: Smartphone-analogous Typing in Augmented Reality
topic Human-Computer Interaction
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.21143