Saved in:
Bibliographic Details
Main Authors: Lee, Geonsun, Yang, Yue, Healey, Jennifer, Manocha, Dinesh
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2503.16739
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913749524283392
author Lee, Geonsun
Yang, Yue
Healey, Jennifer
Manocha, Dinesh
author_facet Lee, Geonsun
Yang, Yue
Healey, Jennifer
Manocha, Dinesh
contents Maintaining engagement in immersive meetings is challenging, particularly when users must catch up on missed content after disruptions. While transcription interfaces can help, table-fixed panels have the potential to distract users from the group, diminishing social presence, while avatar-fixed captions fail to provide past context. We present EngageSync, a context-aware avatar-fixed transcription interface that adapts based on user engagement, offering live transcriptions and LLM-generated summaries to enhance catching up while preserving social presence. We implemented a live VR meeting setup for a 12-participant formative study and elicited design considerations. In two user studies with small (3 avatars) and mid-sized (7 avatars) groups, EngageSync significantly improved social presence (p < .05) and time spent gazing at others in the group instead of the interface over table-fixed panels. Also, it reduced re-engagement time and increased information recall (p < .05) over avatar-fixed interfaces, with stronger effects in mid-sized groups (p < .01).
format Preprint
id arxiv_https___arxiv_org_abs_2503_16739
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Since U Been Gone: Augmenting Context-Aware Transcriptions for Re-engaging in Immersive VR Meetings
Lee, Geonsun
Yang, Yue
Healey, Jennifer
Manocha, Dinesh
Human-Computer Interaction
Maintaining engagement in immersive meetings is challenging, particularly when users must catch up on missed content after disruptions. While transcription interfaces can help, table-fixed panels have the potential to distract users from the group, diminishing social presence, while avatar-fixed captions fail to provide past context. We present EngageSync, a context-aware avatar-fixed transcription interface that adapts based on user engagement, offering live transcriptions and LLM-generated summaries to enhance catching up while preserving social presence. We implemented a live VR meeting setup for a 12-participant formative study and elicited design considerations. In two user studies with small (3 avatars) and mid-sized (7 avatars) groups, EngageSync significantly improved social presence (p < .05) and time spent gazing at others in the group instead of the interface over table-fixed panels. Also, it reduced re-engagement time and increased information recall (p < .05) over avatar-fixed interfaces, with stronger effects in mid-sized groups (p < .01).
title Since U Been Gone: Augmenting Context-Aware Transcriptions for Re-engaging in Immersive VR Meetings
topic Human-Computer Interaction
url https://arxiv.org/abs/2503.16739