Motion-Based User Identification across XR and Metaverse Applications by Deep Classification and Similarity Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Schach, Lukas, Rack, Christian, McMahan, Ryan P., Latoschik, Marc Erich
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915948942852096
author Schach, Lukas
Rack, Christian
McMahan, Ryan P.
Latoschik, Marc Erich
author_facet Schach, Lukas
Rack, Christian
McMahan, Ryan P.
Latoschik, Marc Erich
contents This paper examines the generalization capacity of two state-of-the-art classification and similarity learning models in reliably identifying users based on their motions in various Extended Reality (XR) applications. We developed a novel dataset containing a wide range of motion data from 49 users in five different XR applications: four XR games with distinct tasks and action patterns, and an additional social XR application with no predefined task sets. The dataset is used to evaluate the performance and, in particular, the generalization capacity of the two models across applications. Our results indicate that while the models can accurately identify individuals within the same application, their ability to identify users across different XR applications remains limited. Overall, our results provide insight into current models generalization capabilities and suitability as biometric methods for user verification and identification. The results also serve as a much-needed risk assessment of hazardous and unwanted user identification in XR and Metaverse applications. Our cross-application XR motion dataset and code are made available to the public to encourage similar research on the generalization of motion-based user identification in typical Metaverse application use cases.
format Preprint
id arxiv_https___arxiv_org_abs_2509_08539
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Motion-Based User Identification across XR and Metaverse Applications by Deep Classification and Similarity Learning
Schach, Lukas
Rack, Christian
McMahan, Ryan P.
Latoschik, Marc Erich
Human-Computer Interaction
Machine Learning
This paper examines the generalization capacity of two state-of-the-art classification and similarity learning models in reliably identifying users based on their motions in various Extended Reality (XR) applications. We developed a novel dataset containing a wide range of motion data from 49 users in five different XR applications: four XR games with distinct tasks and action patterns, and an additional social XR application with no predefined task sets. The dataset is used to evaluate the performance and, in particular, the generalization capacity of the two models across applications. Our results indicate that while the models can accurately identify individuals within the same application, their ability to identify users across different XR applications remains limited. Overall, our results provide insight into current models generalization capabilities and suitability as biometric methods for user verification and identification. The results also serve as a much-needed risk assessment of hazardous and unwanted user identification in XR and Metaverse applications. Our cross-application XR motion dataset and code are made available to the public to encourage similar research on the generalization of motion-based user identification in typical Metaverse application use cases.
title Motion-Based User Identification across XR and Metaverse Applications by Deep Classification and Similarity Learning
topic Human-Computer Interaction
Machine Learning
url https://arxiv.org/abs/2509.08539