Toward a Predictive eXtended Reality Teleoperation System with Duo-Virtual Spaces
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866913513991045120 |
|---|---|
| author | Zhang, Ziliang Liu, Cong Kim, Hyoseung |
| author_facet | Zhang, Ziliang Liu, Cong Kim, Hyoseung |
| contents | Extended Reality (XR) provides a more intuitive interaction method for teleoperating robots compared to traditional 2D controls. Recent studies have laid the groundwork for usable teleoperation with XR, but it fails in tasks requiring rapid motion and precise manipulations due to the large delay between user motion and agent feedback. In this work, we profile the end-to-end latency in a state-of-the-art XR teleoperation system and propose our idea to optimize the latency by implementing a duo-virtual spaces design and localizing the agent and objects in the user-side virtual space, while calibrating with periodic ground-truth poses from the agent-side virtual space. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_15464 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Toward a Predictive eXtended Reality Teleoperation System with Duo-Virtual Spaces Zhang, Ziliang Liu, Cong Kim, Hyoseung Robotics Human-Computer Interaction Extended Reality (XR) provides a more intuitive interaction method for teleoperating robots compared to traditional 2D controls. Recent studies have laid the groundwork for usable teleoperation with XR, but it fails in tasks requiring rapid motion and precise manipulations due to the large delay between user motion and agent feedback. In this work, we profile the end-to-end latency in a state-of-the-art XR teleoperation system and propose our idea to optimize the latency by implementing a duo-virtual spaces design and localizing the agent and objects in the user-side virtual space, while calibrating with periodic ground-truth poses from the agent-side virtual space. |
| title | Toward a Predictive eXtended Reality Teleoperation System with Duo-Virtual Spaces |
| topic | Robotics Human-Computer Interaction |
| url | https://arxiv.org/abs/2409.15464 |