HoloSpot: Intuitive Object Manipulation via Mixed Reality Drag-and-Drop
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929543125663744 |
|---|---|
| author | Garcia, Pablo Soler Lukovic, Petar Reynaud, Lucie Sgobbi, Andrea Bruni, Federica Brun, Martin Zünd, Marc Bollati, Riccardo Pollefeys, Marc Blum, Hermann Bauer, Zuria |
| author_facet | Garcia, Pablo Soler Lukovic, Petar Reynaud, Lucie Sgobbi, Andrea Bruni, Federica Brun, Martin Zünd, Marc Bollati, Riccardo Pollefeys, Marc Blum, Hermann Bauer, Zuria |
| contents | Human-robot interaction through mixed reality (MR) technologies enables novel, intuitive interfaces to control robots in remote operations. Such interfaces facilitate operations in hazardous environments, where human presence is risky, yet human oversight remains crucial. Potential environments include disaster response scenarios and areas with high radiation or toxic chemicals. In this paper we present an interface system projecting a 3D representation of a scanned room as a scaled-down 'dollhouse' hologram, allowing users to select and manipulate objects using a straightforward drag-and-drop interface. We then translate these drag-and-drop user commands into real-time robot actions based on the recent Spot-Compose framework. The Unity-based application provides an interactive tutorial and a user-friendly experience, ensuring ease of use. Through comprehensive end-to-end testing, we validate the system's capability in executing pick-and-place tasks and a complementary user study affirms the interface's intuitive controls. Our findings highlight the advantages of this interface in improving user experience and operational efficiency. This work lays the groundwork for a robust framework that advances the potential for seamless human-robot collaboration in diverse applications. Paper website: https://holospot.github.io/ |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_11110 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | HoloSpot: Intuitive Object Manipulation via Mixed Reality Drag-and-Drop Garcia, Pablo Soler Lukovic, Petar Reynaud, Lucie Sgobbi, Andrea Bruni, Federica Brun, Martin Zünd, Marc Bollati, Riccardo Pollefeys, Marc Blum, Hermann Bauer, Zuria Robotics Human-Computer Interaction I.2.9; H.5.2 Human-robot interaction through mixed reality (MR) technologies enables novel, intuitive interfaces to control robots in remote operations. Such interfaces facilitate operations in hazardous environments, where human presence is risky, yet human oversight remains crucial. Potential environments include disaster response scenarios and areas with high radiation or toxic chemicals. In this paper we present an interface system projecting a 3D representation of a scanned room as a scaled-down 'dollhouse' hologram, allowing users to select and manipulate objects using a straightforward drag-and-drop interface. We then translate these drag-and-drop user commands into real-time robot actions based on the recent Spot-Compose framework. The Unity-based application provides an interactive tutorial and a user-friendly experience, ensuring ease of use. Through comprehensive end-to-end testing, we validate the system's capability in executing pick-and-place tasks and a complementary user study affirms the interface's intuitive controls. Our findings highlight the advantages of this interface in improving user experience and operational efficiency. This work lays the groundwork for a robust framework that advances the potential for seamless human-robot collaboration in diverse applications. Paper website: https://holospot.github.io/ |
| title | HoloSpot: Intuitive Object Manipulation via Mixed Reality Drag-and-Drop |
| topic | Robotics Human-Computer Interaction I.2.9; H.5.2 |
| url | https://arxiv.org/abs/2410.11110 |