Cover Image

Augmenting speech transcripts of VR recordings with gaze, pointing, and visual context for multimodal coreference resolution

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Bovo, Riccardo, Brudy, Frederik, Fitzmaurice, George, Anderson, Fraser
Format:	Preprint
Published:	2025
Subjects:	Human-Computer Interaction
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

PlayWrite: A Multimodal System for AI Supported Narrative Co-Authoring Through Play in XR
by: Tütüncü, Esen K., et al.
Published: (2026)

GroundLink: Exploring How Contextual Meeting Snippets Can Close Common Ground Gaps in Editing 3D Scenes for Virtual Production
by: Woo, Gun, et al.
Published: (2026)

PrevizWhiz: Combining Rough 3D Scenes and 2D Video to Guide Generative Video Previsualization
by: Hu, Erzhen, et al.
Published: (2026)

Protosampling: Enabling Free-Form Convergence of Sampling and Prototyping through Canvas-Driven Visual AI Generation
by: Guo, Alicia, et al.
Published: (2026)

AnimationDiff: A Visual Comparison Tool for Generated 3D Character Animations
by: Sidenmark, Ludwig, et al.
Published: (2026)

Revisiting put-that-there, context aware window interactions via LLMs
by: Bovo, Riccardo, et al.
Published: (2025)

Symbiotic AI: Augmenting Human Cognition from PCs to Cars
by: Bovo, Riccardo, et al.
Published: (2025)

Public speech recognition transcripts as a configuring parameter
by: Rudaz, Damien, et al.
Published: (2025)

AQuA: Automated Question-Answering in Software Tutorial Videos with Visual Anchors
by: Yang, Saelyne, et al.
Published: (2024)

Nanomentoring: Investigating How Quickly People Can Help People Learn Feature-Rich Software
by: Drosos, Ian, et al.
Published: (2026)

PointAloud: An Interaction Suite for AI-Supported Pointer-Centric Think-Aloud Computing
by: Gmeiner, Frederic, et al.
Published: (2026)

GPU accelerated surface-based gaze mapping for XR experiences
by: Javerliat, Charles, et al.
Published: (2026)

Transformer-Based Interfaces for Mechanical Assembly Design: A Gear Train Case Study
by: Ataei, Mohammadmehdi, et al.
Published: (2025)

SPARC: Shared Perspective with Avatar Distortion for Remote Collaboration in VR
by: Simões, João, et al.
Published: (2024)

The interplay of user preference and precision in different gaze-based interaction methods
by: Severitt, Björn Rene, et al.
Published: (2025)

Implicit gaze research for XR systems
by: Sendhilnathan, Naveen, et al.
Published: (2024)

The V-Lab VR Educational Application Framework
by: Zafeiropoulos, Vasilis, et al.
Published: (2024)

Can providing feedback on gaze and mental-effort synchrony improve pair programming performance?
by: Golrang, Anahita, et al.
Published: (2026)

SIM2VR: Towards Automated Biomechanical Testing in VR
by: Fischer, Florian, et al.
Published: (2024)

Since U Been Gone: Augmenting Context-Aware Transcriptions for Re-engaging in Immersive VR Meetings
by: Lee, Geonsun, et al.
Published: (2025)

VR MRI Training for Adolescents: A Comparative Study of Gamified VR, Passive VR, 360° Video, and Traditional Educational Video
by: Yang, Yue, et al.
Published: (2025)

Concert Interaction Translation: Augmenting VR Live Concert Experience using Chat-Driven Artificial Collective Reactions
by: Lee, Sebin, et al.
Published: (2025)

Simulating Wearable Urban Augmented Reality Experiences in VR: Lessons Learnt from Designing Two Future Urban Interfaces
by: Tran, Tram Thi Minh, et al.
Published: (2024)

VR Calm Plus: Coupling a Squeezable Tangible Interaction with Immersive VR for Stress Regulation
by: Zhang, He, et al.
Published: (2026)

Towards gaze-independent c-VEP BCI: A pilot study
by: Narayanan, S., et al.
Published: (2024)

FeedQUAC: Quick Unobtrusive AI-Generated Commentary
by: Long, Tao, et al.
Published: (2025)

Ethical Considerations for Observational Research in Social VR
by: Chang, Victoria, et al.
Published: (2025)

Enhancing Manufacturing Training Through VR Simulations
by: Li, Vladislav, et al.
Published: (2025)

Exploring Vulnerabilities in Remote VR User Studies
by: Paneva, Viktorija, et al.
Published: (2024)

The Hall of Singularity: VR Experience of Prophecy by AI
by: Kim, Jisu, et al.
Published: (2024)

Understanding the Effects of Interaction on Emotional Experiences in VR
by: Kuang, Zheyuan, et al.
Published: (2026)

EmBARDiment: an Embodied AI Agent for Productivity in XR
by: Bovo, Riccardo, et al.
Published: (2024)

Influence of field of view in visual prostheses design: Analysis with a VR system
by: Sanchez-Garcia, Melani, et al.
Published: (2025)

RAG-VR: Leveraging Retrieval-Augmented Generation for 3D Question Answering in VR Environments
by: Ding, Shiyi, et al.
Published: (2025)

ShadAR: LLM-driven shader generation to transform visual perception in Augmented Reality
by: Mei, Yanni, et al.
Published: (2026)

Subthreshold Jitter in VR Can Induce Visual Discomfort
by: Levulis, Samuel J., et al.
Published: (2025)

Social VR for Professional Networking: A Spatial Perspective
by: Chang, Victoria, et al.
Published: (2024)

How People Prompt to Create Interactive VR Scenes
by: Manesh, Setareh Aghel, et al.
Published: (2024)

Emotional VR handshake by controlling skin deformation distribution
by: Watatani, Shun, et al.
Published: (2024)

StylusPort: Investigating Teleportation using Stylus in VR
by: Liu, Yang, et al.
Published: (2026)