GhostObjects: Instructing Robots by Manipulating Spatially Aligned Virtual Twins in Augmented Reality
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866918125264437248 |
|---|---|
| author | Wang, Lauren W. Abtahi, Parastoo |
| author_facet | Wang, Lauren W. Abtahi, Parastoo |
| contents | Robots are increasingly capable of autonomous operations, yet human interaction remains essential for issuing personalized instructions. Instead of directly controlling robots through Programming by Demonstration (PbD) or teleoperation, we propose giving instructions by interacting with GhostObjects-world-aligned, life-size virtual twins of physical objects-in augmented reality (AR). By direct manipulation of GhostObjects, users can precisely specify physical goals and spatial parameters, with features including real-world lasso selection of multiple objects and snapping back to default positions, enabling tasks beyond simple pick-and-place. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_11022 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | GhostObjects: Instructing Robots by Manipulating Spatially Aligned Virtual Twins in Augmented Reality Wang, Lauren W. Abtahi, Parastoo Human-Computer Interaction Robotics Robots are increasingly capable of autonomous operations, yet human interaction remains essential for issuing personalized instructions. Instead of directly controlling robots through Programming by Demonstration (PbD) or teleoperation, we propose giving instructions by interacting with GhostObjects-world-aligned, life-size virtual twins of physical objects-in augmented reality (AR). By direct manipulation of GhostObjects, users can precisely specify physical goals and spatial parameters, with features including real-world lasso selection of multiple objects and snapping back to default positions, enabling tasks beyond simple pick-and-place. |
| title | GhostObjects: Instructing Robots by Manipulating Spatially Aligned Virtual Twins in Augmented Reality |
| topic | Human-Computer Interaction Robotics |
| url | https://arxiv.org/abs/2508.11022 |