Cover Image

Integrating Large Language Models with Multimodal Virtual Reality Interfaces to Support Collaborative Human-Robot Construction Work

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Park, Somin, Menassa, Carol C., Kamat, Vineet R.
Format:	Preprint
Published:	2024
Subjects:	Robotics Human-Computer Interaction
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Natural Language Instructions for Intuitive Human Interaction with Robotic Assistants in Field Construction Work
by: Park, Somin, et al.
Published: (2023)

Feasibility of Embodied Dynamics Based Bayesian Learning for Continuous Pursuit Motion Control of Assistive Mobile Robots in the Built Environment
by: Zhou, Xiaoshan, et al.
Published: (2025)

Siamese Network with Dual Attention for EEG-Driven Social Learning: Bridging the Human-Robot Gap in Long-Tail Autonomous Driving
by: Zhou, Xiaoshan, et al.
Published: (2025)

Towards Probabilistic Inference of Human Motor Intentions by Assistive Mobile Robots Controlled via a Brain-Computer Interface
by: Zhou, Xiaoshan, et al.
Published: (2025)

Socially-Aware Shared Control Navigation for Assistive Mobile Robots in the Built Environment
by: Xu, Yifan, et al.
Published: (2024)

OpenGuide: Assistive Object Retrieval in Indoor Spaces for Individuals with Visual Impairments
by: Xu, Yifan, et al.
Published: (2025)

Biologically Inspired Predictive Coding TCN-Transformer for Anticipatory Human-Robot Interaction in Shared Physical Spaces
by: Zhou, Xiaoshan, et al.
Published: (2024)

Interoceptive Robots for Convergent Shared Control in Collaborative Construction Work
by: Zhou, Xiaoshan, et al.
Published: (2025)

Advancing Improvisation in Human-Robot Construction Collaboration: Taxonomy and Research Roadmap
by: Atibila, David Wireko, et al.
Published: (2026)

Generalizable Skill Learning for Construction Robots with Crowdsourced Natural Language Instructions, Composable Skills Standardization, and Large Language Model
by: Yu, Hongrui, et al.
Published: (2025)

Cloud-Based Hierarchical Imitation Learning for Scalable Transfer of Construction Skills from Human Workers to Assisting Robots
by: Yu, Hongrui, et al.
Published: (2023)

Enhancing Human-Robot Collaborative Assembly in Manufacturing Systems Using Large Language Models
by: Lim, Jonghan, et al.
Published: (2024)

Don't Yell at Your Robot: Physical Correction as the Collaborative Interface for Language Model Powered Robots
by: Zhang, Chuye, et al.
Published: (2024)

Alternative Interfaces for Human-initiated Natural Language Communication and Robot-initiated Haptic Feedback: Towards Better Situational Awareness in Human-Robot Collaboration
by: Bennie, Callum, et al.
Published: (2024)

Reframing Human-Robot Interaction Through Extended Reality: Unlocking Safer, Smarter, and More Empathic Interactions with Virtual Robots and Foundation Models
by: Zhang, Yuchong, et al.
Published: (2025)

Enabling Building Information Model-Driven Human-Robot Collaborative Construction Workflows with Closed-Loop Digital Twins
by: Wang, Xi, et al.
Published: (2023)

Adaptive Human-Robot Collaboration for Masonry Construction Under Material and Assembly Uncertainty
by: Gao, Jutang, et al.
Published: (2026)

Testing Human-Robot Interaction in Virtual Reality: Experience from a Study on Speech Act Classification
by: Kaszuba, Sara, et al.
Published: (2024)

How Robot Kinematics Influence Human Performance in Virtual Robot-to-Human Handover Tasks
by: Keenan, Róisín, et al.
Published: (2025)

Spot-On: A Mixed Reality Interface for Multi-Robot Cooperation
by: Engelbracht, Tim, et al.
Published: (2025)

Extended Reality for Enhanced Human-Robot Collaboration: a Human-in-the-Loop Approach
by: Karpichev, Yehor, et al.
Published: (2024)

Gesture First, LLM-Assisted Voice Complement: Exploring Multimodal Robot 'Puppeteer' Teleoperation Via Virtual Counterpart in Augmented Reality
by: Zhang, Yuchong, et al.
Published: (2025)

ERUPT: An Open Toolkit for Interfacing with Robot Motion Planners in Extended Reality
by: Ngui, Isaac, et al.
Published: (2025)

HORUS: A Mixed Reality Interface for Managing Teams of Mobile Robots
by: Adekoya, Omotoye Shamsudeen, et al.
Published: (2025)

Grasping Object: Challenges and Innovations in Robotics and Virtual Reality
by: Zhou, Mingzhao, et al.
Published: (2024)

Human Interaction for Collaborative Semantic SLAM using Extended Reality
by: Ribeiro, Laura, et al.
Published: (2025)

Enabling Waypoint Generation for Collaborative Robots using LLMs and Mixed Reality
by: Fang, Cathy Mengying, et al.
Published: (2024)

The RoSiD Tool: Empowering Users to Design Multimodal Signals for Human-Robot Collaboration
by: Dennler, Nathaniel, et al.
Published: (2024)

On the Design of Human-Robot Collaboration Gestures
by: Shrinah, Anas, et al.
Published: (2024)

Understanding Large-Language Model (LLM)-powered Human-Robot Interaction
by: Kim, Callie Y., et al.
Published: (2024)

ReachVox: Clutter-free Reachability Visualization for Robot Motion Planning in Virtual Reality
by: Hauck, Steffen, et al.
Published: (2025)

GhostObjects: Instructing Robots by Manipulating Spatially Aligned Virtual Twins in Augmented Reality
by: Wang, Lauren W., et al.
Published: (2025)

An Approach to Elicit Human-Understandable Robot Expressions to Support Human-Robot Interaction
by: Leusmann, Jan, et al.
Published: (2024)

Extended Reality System for Robotic Learning from Human Demonstration
by: Ngui, Isaac, et al.
Published: (2024)

LaMI: Large Language Models for Multi-Modal Human-Robot Interaction
by: Wang, Chao, et al.
Published: (2024)

KUKAloha: A General, Low-Cost, and Shared-Control based Teleoperation Framework for Construction Robot Arm
by: Xu, Yifan, et al.
Published: (2026)

Integrating Flow Theory and Adaptive Robot Roles: A Conceptual Model of Dynamic Robot Role Adaptation for the Enhanced Flow Experience in Long-term Multi-person Human-Robot Interactions
by: Chen, Huili, et al.
Published: (2024)

Applying Ontologies and Knowledge Augmented Large Language Models to Industrial Automation: A Decision-Making Guidance for Achieving Human-Robot Collaboration in Industry 5.0
by: Oyekan, John, et al.
Published: (2025)

Gaze-supported Large Language Model Framework for Bi-directional Human-Robot Interaction
by: Rüppel, Jens V., et al.
Published: (2025)

Impact of Cognitive Load on Human Trust in Hybrid Human-Robot Collaboration
by: Guo, Hao, et al.
Published: (2024)