Log2Motion: Biomechanical Motion Synthesis from Touch Logs

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Miazga, Michał Patryk, Bussmann, Hannah, Oulasvirta, Antti, Ebel, Patrick
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914307396075520
author Miazga, Michał Patryk
Bussmann, Hannah
Oulasvirta, Antti
Ebel, Patrick
author_facet Miazga, Michał Patryk
Bussmann, Hannah
Oulasvirta, Antti
Ebel, Patrick
contents Touch data from mobile devices are collected at scale but reveal little about the interactions that produce them. While biomechanical simulations can illuminate motor control processes, they have not yet been developed for touch interactions. To close this gap, we propose a novel computational problem: synthesizing plausible motion directly from logs. Our key insight is a reinforcement learning-driven musculoskeletal forward simulation that generates biomechanically plausible motion sequences consistent with events recorded in touch logs. We achieve this by integrating a software emulator into a physics simulator, allowing biomechanical models to manipulate real applications in real-time. Log2Motion produces rich syntheses of user movements from touch logs, including estimates of motion, speed, accuracy, and effort. We assess the plausibility of generated movements by comparing against human data from a motion capture study and prior findings, and demonstrate Log2Motion in a large-scale dataset. Biomechanical motion synthesis provides a new way to understand log data, illuminating the ergonomics and motor control underlying touch interactions.
format Preprint
id arxiv_https___arxiv_org_abs_2601_21043
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Log2Motion: Biomechanical Motion Synthesis from Touch Logs
Miazga, Michał Patryk
Bussmann, Hannah
Oulasvirta, Antti
Ebel, Patrick
Human-Computer Interaction
Artificial Intelligence
Touch data from mobile devices are collected at scale but reveal little about the interactions that produce them. While biomechanical simulations can illuminate motor control processes, they have not yet been developed for touch interactions. To close this gap, we propose a novel computational problem: synthesizing plausible motion directly from logs. Our key insight is a reinforcement learning-driven musculoskeletal forward simulation that generates biomechanically plausible motion sequences consistent with events recorded in touch logs. We achieve this by integrating a software emulator into a physics simulator, allowing biomechanical models to manipulate real applications in real-time. Log2Motion produces rich syntheses of user movements from touch logs, including estimates of motion, speed, accuracy, and effort. We assess the plausibility of generated movements by comparing against human data from a motion capture study and prior findings, and demonstrate Log2Motion in a large-scale dataset. Biomechanical motion synthesis provides a new way to understand log data, illuminating the ergonomics and motor control underlying touch interactions.
title Log2Motion: Biomechanical Motion Synthesis from Touch Logs
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2601.21043