Visualizing Causality in Mixed Reality for Manual Task Learning: An Exploratory Study

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Jain, Rahul, Shi, Jingyu, Benton, Andrew, Rasheed, Moiz, Doh, Hyungjun, Chidambaram, Subramanian, Ramani, Karthik
Format: Preprint
Publié: 2023
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909517429604352
author Jain, Rahul
Shi, Jingyu
Benton, Andrew
Rasheed, Moiz
Doh, Hyungjun
Chidambaram, Subramanian
Ramani, Karthik
author_facet Jain, Rahul
Shi, Jingyu
Benton, Andrew
Rasheed, Moiz
Doh, Hyungjun
Chidambaram, Subramanian
Ramani, Karthik
contents Mixed Reality (MR) is gaining prominence in manual task skill learning due to its in-situ, embodied, and immersive experience. To teach manual tasks, current methodologies break the task into hierarchies (tasks into subtasks) and visualize the current subtask and future in terms of causality. Existing psychology literature also shows that humans learn tasks by breaking them into hierarchies. In order to understand the design space of information visualized to the learner for better task understanding, we conducted a user study with 48 users. The study was conducted using a complex assembly task, which involves learning of both actions and tool usage. We aim to explore the effect of visualization of causality in the hierarchy for manual task learning in MR by four options: no causality, event level causality, interaction level causality, and gesture level causality. The results show that the user understands and performs best when all the level of causality is shown to the user. Based on the results, we further provide design recommendations and in-depth discussions for future manual task learning systems.
format Preprint
id arxiv_https___arxiv_org_abs_2310_13167
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Visualizing Causality in Mixed Reality for Manual Task Learning: An Exploratory Study
Jain, Rahul
Shi, Jingyu
Benton, Andrew
Rasheed, Moiz
Doh, Hyungjun
Chidambaram, Subramanian
Ramani, Karthik
Human-Computer Interaction
Mixed Reality (MR) is gaining prominence in manual task skill learning due to its in-situ, embodied, and immersive experience. To teach manual tasks, current methodologies break the task into hierarchies (tasks into subtasks) and visualize the current subtask and future in terms of causality. Existing psychology literature also shows that humans learn tasks by breaking them into hierarchies. In order to understand the design space of information visualized to the learner for better task understanding, we conducted a user study with 48 users. The study was conducted using a complex assembly task, which involves learning of both actions and tool usage. We aim to explore the effect of visualization of causality in the hierarchy for manual task learning in MR by four options: no causality, event level causality, interaction level causality, and gesture level causality. The results show that the user understands and performs best when all the level of causality is shown to the user. Based on the results, we further provide design recommendations and in-depth discussions for future manual task learning systems.
title Visualizing Causality in Mixed Reality for Manual Task Learning: An Exploratory Study
topic Human-Computer Interaction
url https://arxiv.org/abs/2310.13167