TouchWalker: Real-Time Avatar Locomotion from Touchscreen Finger Walking

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Park, Geuntae, Yi, Jiwon, Rhee, Taehyun, Kim, Kwanguk, Lee, Yoonsang
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866915611818328064
author Park, Geuntae
Yi, Jiwon
Rhee, Taehyun
Kim, Kwanguk
Lee, Yoonsang
author_facet Park, Geuntae
Yi, Jiwon
Rhee, Taehyun
Kim, Kwanguk
Lee, Yoonsang
contents We present TouchWalker, a real-time system for controlling full-body avatar locomotion using finger-walking gestures on a touchscreen. The system comprises two main components: TouchWalker-MotionNet, a neural motion generator that synthesizes full-body avatar motion on a per-frame basis from temporally sparse two-finger input, and TouchWalker-UI, a compact touch interface that interprets user touch input to avatar-relative foot positions. Unlike prior systems that rely on symbolic gesture triggers or predefined motion sequences, TouchWalker uses its neural component to generate continuous, context-aware full-body motion on a per-frame basis-including airborne phases such as running, even without input during mid-air steps-enabling more expressive and immediate interaction. To ensure accurate alignment between finger contacts and avatar motion, it employs a MoE-GRU architecture with a dedicated foot-alignment loss. We evaluate TouchWalker in a user study comparing it to a virtual joystick baseline with predefined motion across diverse locomotion tasks. Results show that TouchWalker improves users' sense of embodiment, enjoyment, and immersion.
format Preprint
id arxiv_https___arxiv_org_abs_2511_07860
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle TouchWalker: Real-Time Avatar Locomotion from Touchscreen Finger Walking
Park, Geuntae
Yi, Jiwon
Rhee, Taehyun
Kim, Kwanguk
Lee, Yoonsang
Human-Computer Interaction
Graphics
We present TouchWalker, a real-time system for controlling full-body avatar locomotion using finger-walking gestures on a touchscreen. The system comprises two main components: TouchWalker-MotionNet, a neural motion generator that synthesizes full-body avatar motion on a per-frame basis from temporally sparse two-finger input, and TouchWalker-UI, a compact touch interface that interprets user touch input to avatar-relative foot positions. Unlike prior systems that rely on symbolic gesture triggers or predefined motion sequences, TouchWalker uses its neural component to generate continuous, context-aware full-body motion on a per-frame basis-including airborne phases such as running, even without input during mid-air steps-enabling more expressive and immediate interaction. To ensure accurate alignment between finger contacts and avatar motion, it employs a MoE-GRU architecture with a dedicated foot-alignment loss. We evaluate TouchWalker in a user study comparing it to a virtual joystick baseline with predefined motion across diverse locomotion tasks. Results show that TouchWalker improves users' sense of embodiment, enjoyment, and immersion.
title TouchWalker: Real-Time Avatar Locomotion from Touchscreen Finger Walking
topic Human-Computer Interaction
Graphics
url https://arxiv.org/abs/2511.07860