Copertina

Reality Copilot: Voice-First Human-AI Collaboration in Mixed Reality Using Large Multimodal Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Yu, Liuchuan, Zhang, Yongqi, Yu, Lap-Fai
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Human-Computer Interaction
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

You Are Not Alone: Designing Body Doubling for ADHD in Virtual Reality
di: Ara, Zinat, et al.
Pubblicazione: (2025)

Col-Con: A Virtual Reality Simulation Testbed for Exploring Collaborative Behaviors in Construction
di: Yu, Liuchuan, et al.
Pubblicazione: (2024)

Enriching physical-virtual interaction in AR gaming by tracking identical objects via an egocentric partial observation frame
di: Yu, Liuchuan, et al.
Pubblicazione: (2025)

Practice-informed Patterns for Organising Large Groups in Distributed Mixed Reality Collaboration
di: Wong, Emily, et al.
Pubblicazione: (2024)

Integrating Large Language Models with Multimodal Virtual Reality Interfaces to Support Collaborative Human-Robot Construction Work
di: Park, Somin, et al.
Pubblicazione: (2024)

Decoupled Hands: An Approach for Aligning Perspectives in Collaborative Mixed Reality
di: Gottsacker, Matt, et al.
Pubblicazione: (2025)

Customizing Generated Signs and Voices of AI Avatars: Deaf-Centric Mixed-Reality Design for Deaf-Hearing Communication
di: Chen, Si, et al.
Pubblicazione: (2024)

Secure and Private Spatial Sharing for Mixed Reality Remote Collaboration in Enterprise Settings
di: Chen, Mengyu, et al.
Pubblicazione: (2026)

Don't Leave Me Out: Designing for Device Inclusivity in Mixed Reality Collaboration
di: Krug, Katja, et al.
Pubblicazione: (2024)

Gesture First, LLM-Assisted Voice Complement: Exploring Multimodal Robot 'Puppeteer' Teleoperation Via Virtual Counterpart in Augmented Reality
di: Zhang, Yuchong, et al.
Pubblicazione: (2025)

Crafting Dynamic Virtual Activities with Advanced Multimodal Models
di: Li, Changyang, et al.
Pubblicazione: (2024)

Assessing User Apprehensions About Mixed Reality Artifacts and Applications: The Mixed Reality Concerns (MRC) Questionnaire
di: Katins, Christopher, et al.
Pubblicazione: (2024)

Enabling Waypoint Generation for Collaborative Robots using LLMs and Mixed Reality
di: Fang, Cathy Mengying, et al.
Pubblicazione: (2024)

Understood: Real-Time Communication Support for Adults with ADHD Using Mixed Reality
di: Zhang, Shizhen, et al.
Pubblicazione: (2025)

Human Interaction for Collaborative Semantic SLAM using Extended Reality
di: Ribeiro, Laura, et al.
Pubblicazione: (2025)

Desk2Desk: Optimization-based Mixed Reality Workspace Integration for Remote Side-by-side Collaboration
di: Sidenmark, Ludwig, et al.
Pubblicazione: (2024)

Managing Information Overload in Large-Scale Distributed Mixed-Reality Meetings
di: Krug, Katja, et al.
Pubblicazione: (2025)

Explainable Interfaces for Rapid Gaze-Based Interactions in Mixed Reality
di: Yu, Mengjie, et al.
Pubblicazione: (2024)

Unbounded: Object-Boundary Interaction in Mixed Reality
di: Lyu, Zhuoyue, et al.
Pubblicazione: (2025)

RealitySummary: Exploring On-Demand Mixed Reality Text Summarization and Question Answering using Large Language Models
di: Gunturu, Aditya, et al.
Pubblicazione: (2024)

GazePointAR: A Context-Aware Multimodal Voice Assistant for Pronoun Disambiguation in Wearable Augmented Reality
di: Lee, Jaewook, et al.
Pubblicazione: (2024)

What Sensors See, What People Feel: An Exploratory Study of Subjective Collaboration Perception in Mixed Reality
di: Chandio, Yasra, et al.
Pubblicazione: (2025)

Mixed Reality Outperforms Virtual Reality for Remote Error Resolution in Pick-and-Place Tasks
di: Kumar, Advay, et al.
Pubblicazione: (2025)

Challenges in Mixed Reality in Assisting Adults with ADHD Symptoms
di: Tan, Valerie, et al.
Pubblicazione: (2025)

The Virtual Reality Koinos Method: Analysis of Symmetrical Dyadic Collaboration in Virtual Reality from the perspective of communication models
di: Minder, Eloise, et al.
Pubblicazione: (2025)

ARTHUR: Authoring Human-Robot Collaboration Processes with Augmented Reality using Hybrid User Interfaces
di: Lunding, Rasmus, et al.
Pubblicazione: (2025)

Generation of Real-time Robotic Emotional Expressions Learning from Human Demonstration in Mixed Reality
di: Wang, Chao, et al.
Pubblicazione: (2025)

Mixed or Misperceived Reality? Flusserian Media Freedom through Surreal Me
di: Zhou, Aven-Le, et al.
Pubblicazione: (2024)

Stability and Transparency in Mixed Reality Bilateral Human Teleoperation
di: Black, David Gregory, et al.
Pubblicazione: (2024)

MR-DAW: Towards Collaborative Digital Audio Workstations in Mixed Reality
di: Hopkins, Torin, et al.
Pubblicazione: (2026)

Human-Augmented Reality Interaction in Rebar Inspection
di: Sanei, Mahsa, et al.
Pubblicazione: (2026)

XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot
di: Plümer, Jan Hendrik, et al.
Pubblicazione: (2024)

A Survey on Methodological Approaches to Collaborative Embodiment in Virtual Reality
di: Zhou, Hongyu, et al.
Pubblicazione: (2025)

Tap into Reality: Understanding the Impact of Interactions on Presence and Reaction Time in Mixed Reality
di: Chandio, Yasra, et al.
Pubblicazione: (2024)

A Roadmap of Mixed Reality Body Doubling for Adults with ADHD
di: Tan, Valerie, et al.
Pubblicazione: (2026)

Exploring Keyboard Positioning and Ten-Finger Typing in Mixed Reality
di: Schmitz, Cecilia, et al.
Pubblicazione: (2024)

Temperature Illusions in Mixed Reality using Color and Dynamic Graphics
di: Wilson, Connor, et al.
Pubblicazione: (2024)

Surrealism Me: Interactive Virtual Embodying Experiences in Mixed Reality
di: Zhou, Aven Le
Pubblicazione: (2024)

Co-Designing Dynamic Mixed Reality Drill Positioning Widgets: A Collaborative Approach with Dentists in a Realistic Setup
di: Dastan, Mine, et al.
Pubblicazione: (2024)

Exploring the Feasibility of Multimodal Chatbot AI as Copilot in Pathology Diagnostics: Generalist Model's Pitfall
di: Liu, Mianxin, et al.
Pubblicazione: (2024)