eXplainMR: Generating Real-time Textual and Visual eXplanations to Facilitate UltraSonography Learning in MR

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wang, Jingying, Zhang, Jingjing, Capizzano, Juana Nicoll, Sigakis, Matthew, Wang, Xu, Popov, Vitaliy
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909513949380608
author Wang, Jingying
Zhang, Jingjing
Capizzano, Juana Nicoll
Sigakis, Matthew
Wang, Xu
Popov, Vitaliy
author_facet Wang, Jingying
Zhang, Jingjing
Capizzano, Juana Nicoll
Sigakis, Matthew
Wang, Xu
Popov, Vitaliy
contents eXplainMR is a Mixed Reality tutoring system designed for basic cardiac surface ultrasound training. Trainees wear a head-mounted display (HMD) and hold a controller, mimicking a real ultrasound probe, while treating a desk surface as the patient's body for low-cost and anywhere training. eXplainMR engages trainees with troubleshooting questions and provides automated feedback through four key mechanisms: 1) subgoals that break down tasks into single-movement steps, 2) textual explanations comparing the current incorrect view with the target view, 3) real-time segmentation and annotation of ultrasound images for direct visualization, and 4) the 3D visual cues provide further explanations on the intersection between the slicing plane and anatomies.
format Preprint
id arxiv_https___arxiv_org_abs_2502_18640
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle eXplainMR: Generating Real-time Textual and Visual eXplanations to Facilitate UltraSonography Learning in MR
Wang, Jingying
Zhang, Jingjing
Capizzano, Juana Nicoll
Sigakis, Matthew
Wang, Xu
Popov, Vitaliy
Human-Computer Interaction
eXplainMR is a Mixed Reality tutoring system designed for basic cardiac surface ultrasound training. Trainees wear a head-mounted display (HMD) and hold a controller, mimicking a real ultrasound probe, while treating a desk surface as the patient's body for low-cost and anywhere training. eXplainMR engages trainees with troubleshooting questions and provides automated feedback through four key mechanisms: 1) subgoals that break down tasks into single-movement steps, 2) textual explanations comparing the current incorrect view with the target view, 3) real-time segmentation and annotation of ultrasound images for direct visualization, and 4) the 3D visual cues provide further explanations on the intersection between the slicing plane and anatomies.
title eXplainMR: Generating Real-time Textual and Visual eXplanations to Facilitate UltraSonography Learning in MR
topic Human-Computer Interaction
url https://arxiv.org/abs/2502.18640