Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2410.16686 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910053121916928 |
|---|---|
| author | Hossain, Jumman Dey, Emon Chugh, Snehalraj Ahmed, Masud Anwar, MS Faridee, Abu-Zaher Hoppes, Jason Trout, Theron Basak, Anjon Chowdhury, Rafidh Mistry, Rishabh Kim, Hyun Freeman, Jade Suri, Niranjan Raglin, Adrienne Busart, Carl Ravi, Anuradha Roy, Nirmalya |
| author_facet | Hossain, Jumman Dey, Emon Chugh, Snehalraj Ahmed, Masud Anwar, MS Faridee, Abu-Zaher Hoppes, Jason Trout, Theron Basak, Anjon Chowdhury, Rafidh Mistry, Rishabh Kim, Hyun Freeman, Jade Suri, Niranjan Raglin, Adrienne Busart, Carl Ravi, Anuradha Roy, Nirmalya |
| contents | Cross reality integration of simulation and physical robots is a promising approach for multi-robot operations in contested environments, where communication may be intermittent, interference may be present, and observability may be degraded. We present SERN (Simulation-Enhanced Realistic Navigation), a framework that tightly couples a high-fidelity virtual twin with physical robots to support real-time collaborative decision making. SERN makes three main contributions. First, it builds a virtual twin from geospatial and sensor data and continuously corrects it using live robot telemetry. Second, it introduces a physics-aware synchronization pipeline that combines predictive modeling with adaptive PD control. Third, it provides a bandwidth-adaptive ROS bridge that prioritizes critical topics when communication links are constrained. We also introduce a multi-metric cost function that balances latency, reliability, computation, and bandwidth. Theoretically, we show that when the adaptive controller keeps the physical and virtual input mismatch small, synchronization error remains bounded under moderate packet loss and latency. Empirically, SERN reduces end-to-end message latency by 15% to 25% and processing load by about 15% compared with a standard ROS setup, while maintaining tight real-virtual alignment with less than 5 cm positional error and less than 2 degrees rotational error. In a navigation task, SERN achieves a 95% success rate, compared with 85% for a real-only setup and 70% for a simulation-only setup, while also requiring fewer interventions and less time to reach the goal. These results show that a simulation-enhanced cross-reality stack can improve situational awareness and multi-agent coordination in contested environments by enabling look-ahead planning in the virtual twin while using real sensor feedback to correct discrepancies. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_16686 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | SERN: Bandwidth-Adaptive Cross-Reality Synchronization for Simulation-Enhanced Robot Navigation Hossain, Jumman Dey, Emon Chugh, Snehalraj Ahmed, Masud Anwar, MS Faridee, Abu-Zaher Hoppes, Jason Trout, Theron Basak, Anjon Chowdhury, Rafidh Mistry, Rishabh Kim, Hyun Freeman, Jade Suri, Niranjan Raglin, Adrienne Busart, Carl Ravi, Anuradha Roy, Nirmalya Robotics Multiagent Systems Cross reality integration of simulation and physical robots is a promising approach for multi-robot operations in contested environments, where communication may be intermittent, interference may be present, and observability may be degraded. We present SERN (Simulation-Enhanced Realistic Navigation), a framework that tightly couples a high-fidelity virtual twin with physical robots to support real-time collaborative decision making. SERN makes three main contributions. First, it builds a virtual twin from geospatial and sensor data and continuously corrects it using live robot telemetry. Second, it introduces a physics-aware synchronization pipeline that combines predictive modeling with adaptive PD control. Third, it provides a bandwidth-adaptive ROS bridge that prioritizes critical topics when communication links are constrained. We also introduce a multi-metric cost function that balances latency, reliability, computation, and bandwidth. Theoretically, we show that when the adaptive controller keeps the physical and virtual input mismatch small, synchronization error remains bounded under moderate packet loss and latency. Empirically, SERN reduces end-to-end message latency by 15% to 25% and processing load by about 15% compared with a standard ROS setup, while maintaining tight real-virtual alignment with less than 5 cm positional error and less than 2 degrees rotational error. In a navigation task, SERN achieves a 95% success rate, compared with 85% for a real-only setup and 70% for a simulation-only setup, while also requiring fewer interventions and less time to reach the goal. These results show that a simulation-enhanced cross-reality stack can improve situational awareness and multi-agent coordination in contested environments by enabling look-ahead planning in the virtual twin while using real sensor feedback to correct discrepancies. |
| title | SERN: Bandwidth-Adaptive Cross-Reality Synchronization for Simulation-Enhanced Robot Navigation |
| topic | Robotics Multiagent Systems |
| url | https://arxiv.org/abs/2410.16686 |