HybridCollab: Unifying In-Person and Remote Collaboration for Cardiovascular Surgical Planning in Mobile Augmented Reality

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Mehta, Pratham Darrpan, Narayanan, Rahul Ozhur, Kulkarni, Vidhi, Slesnick, Timothy, Shaw, Fawwaz, Chau, Duen Horng
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916689125310464
author Mehta, Pratham Darrpan
Narayanan, Rahul Ozhur
Kulkarni, Vidhi
Slesnick, Timothy
Shaw, Fawwaz
Chau, Duen Horng
author_facet Mehta, Pratham Darrpan
Narayanan, Rahul Ozhur
Kulkarni, Vidhi
Slesnick, Timothy
Shaw, Fawwaz
Chau, Duen Horng
contents Surgical planning for congenital heart disease traditionally relies on collaborative group examinations of a patient's 3D-printed heart model, a process that lacks flexibility and accessibility. While mobile augmented reality (AR) offers a promising alternative with its portability and familiar interaction gestures, existing solutions limit collaboration to users in the same physical space. We developed HybridCollab, the first iOS AR application that introduces a novel paradigm that enables both in-person and remote medical teams to interact with a shared AR heart model in a single surgical planning session. For example, a team of two doctors in one hospital room can collaborate in real time with another team in a different hospital.Our approach is the first to leverage Apple's GameKit service for surgical planning, ensuring an identical collaborative experience for all participants, regardless of location. Additionally, co-located users can interact with the same anchored heart model in their shared physical space. By bridging the gap between remote and in-person collaboration across medical teams, HybridCollab has the potential for significant real-world impact, streamlining communication and enhancing the effectiveness of surgical planning. Watch the demo: https://youtu.be/hElqJYDuvLM.
format Preprint
id arxiv_https___arxiv_org_abs_2504_10440
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle HybridCollab: Unifying In-Person and Remote Collaboration for Cardiovascular Surgical Planning in Mobile Augmented Reality
Mehta, Pratham Darrpan
Narayanan, Rahul Ozhur
Kulkarni, Vidhi
Slesnick, Timothy
Shaw, Fawwaz
Chau, Duen Horng
Human-Computer Interaction
Surgical planning for congenital heart disease traditionally relies on collaborative group examinations of a patient's 3D-printed heart model, a process that lacks flexibility and accessibility. While mobile augmented reality (AR) offers a promising alternative with its portability and familiar interaction gestures, existing solutions limit collaboration to users in the same physical space. We developed HybridCollab, the first iOS AR application that introduces a novel paradigm that enables both in-person and remote medical teams to interact with a shared AR heart model in a single surgical planning session. For example, a team of two doctors in one hospital room can collaborate in real time with another team in a different hospital.Our approach is the first to leverage Apple's GameKit service for surgical planning, ensuring an identical collaborative experience for all participants, regardless of location. Additionally, co-located users can interact with the same anchored heart model in their shared physical space. By bridging the gap between remote and in-person collaboration across medical teams, HybridCollab has the potential for significant real-world impact, streamlining communication and enhancing the effectiveness of surgical planning. Watch the demo: https://youtu.be/hElqJYDuvLM.
title HybridCollab: Unifying In-Person and Remote Collaboration for Cardiovascular Surgical Planning in Mobile Augmented Reality
topic Human-Computer Interaction
url https://arxiv.org/abs/2504.10440