Saved in:
Bibliographic Details
Main Authors: Ngui, Isaac, McBeth, Courtney, Santos, André, He, Grace, Mimnaugh, Katherine J., Motes, James D., Soares, Luciano, Morales, Marco, Amato, Nancy M.
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2510.02464
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909822710972416
author Ngui, Isaac
McBeth, Courtney
Santos, André
He, Grace
Mimnaugh, Katherine J.
Motes, James D.
Soares, Luciano
Morales, Marco
Amato, Nancy M.
author_facet Ngui, Isaac
McBeth, Courtney
Santos, André
He, Grace
Mimnaugh, Katherine J.
Motes, James D.
Soares, Luciano
Morales, Marco
Amato, Nancy M.
contents We propose the Extended Reality Universal Planning Toolkit (ERUPT), an extended reality (XR) system for interactive motion planning. Our system allows users to create and dynamically reconfigure environments while they plan robot paths. In immersive three-dimensional XR environments, users gain a greater spatial understanding. XR also unlocks a broader range of natural interaction capabilities, allowing users to grab and adjust objects in the environment similarly to the real world, rather than using a mouse and keyboard with the scene projected onto a two-dimensional computer screen. Our system integrates with MoveIt, a manipulation planning framework, allowing users to send motion planning requests and visualize the resulting robot paths in virtual or augmented reality. We provide a broad range of interaction modalities, allowing users to modify objects in the environment and interact with a virtual robot. Our system allows operators to visualize robot motions, ensuring desired behavior as it moves throughout the environment, without risk of collisions within a virtual space, and to then deploy planned paths on physical robots in the real world.
format Preprint
id arxiv_https___arxiv_org_abs_2510_02464
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ERUPT: An Open Toolkit for Interfacing with Robot Motion Planners in Extended Reality
Ngui, Isaac
McBeth, Courtney
Santos, André
He, Grace
Mimnaugh, Katherine J.
Motes, James D.
Soares, Luciano
Morales, Marco
Amato, Nancy M.
Robotics
Human-Computer Interaction
We propose the Extended Reality Universal Planning Toolkit (ERUPT), an extended reality (XR) system for interactive motion planning. Our system allows users to create and dynamically reconfigure environments while they plan robot paths. In immersive three-dimensional XR environments, users gain a greater spatial understanding. XR also unlocks a broader range of natural interaction capabilities, allowing users to grab and adjust objects in the environment similarly to the real world, rather than using a mouse and keyboard with the scene projected onto a two-dimensional computer screen. Our system integrates with MoveIt, a manipulation planning framework, allowing users to send motion planning requests and visualize the resulting robot paths in virtual or augmented reality. We provide a broad range of interaction modalities, allowing users to modify objects in the environment and interact with a virtual robot. Our system allows operators to visualize robot motions, ensuring desired behavior as it moves throughout the environment, without risk of collisions within a virtual space, and to then deploy planned paths on physical robots in the real world.
title ERUPT: An Open Toolkit for Interfacing with Robot Motion Planners in Extended Reality
topic Robotics
Human-Computer Interaction
url https://arxiv.org/abs/2510.02464