Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2410.14117 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929549645709312 |
|---|---|
| author | Chu, Shuguang Huang, Zebin Lin, Mingwei Li, Dejun Carlucho, Ignacio |
| author_facet | Chu, Shuguang Huang, Zebin Lin, Mingwei Li, Dejun Carlucho, Ignacio |
| contents | Reinforcement Learning (RL) is a promising solution, allowing Unmanned Underwater Vehicles (UUVs) to learn optimal behaviors through trial and error. However, existing simulators lack efficient integration with RL methods, limiting training scalability and performance. This paper introduces MarineGym, a novel simulation framework designed to enhance RL training efficiency for UUVs by utilizing GPU acceleration. MarineGym offers a 10,000-fold performance improvement over real-time simulation on a single GPU, enabling rapid training of RL algorithms across multiple underwater tasks. Key features include realistic dynamic modeling of UUVs, parallel environment execution, and compatibility with popular RL frameworks like PyTorch and TorchRL. The framework is validated through four distinct tasks: station-keeping, circle tracking, helical tracking, and lemniscate tracking. This framework sets the stage for advancing RL in underwater robotics and facilitating efficient training in complex, dynamic environments. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_14117 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | MarineGym: Accelerated Training for Underwater Vehicles with High-Fidelity RL Simulation Chu, Shuguang Huang, Zebin Lin, Mingwei Li, Dejun Carlucho, Ignacio Robotics Reinforcement Learning (RL) is a promising solution, allowing Unmanned Underwater Vehicles (UUVs) to learn optimal behaviors through trial and error. However, existing simulators lack efficient integration with RL methods, limiting training scalability and performance. This paper introduces MarineGym, a novel simulation framework designed to enhance RL training efficiency for UUVs by utilizing GPU acceleration. MarineGym offers a 10,000-fold performance improvement over real-time simulation on a single GPU, enabling rapid training of RL algorithms across multiple underwater tasks. Key features include realistic dynamic modeling of UUVs, parallel environment execution, and compatibility with popular RL frameworks like PyTorch and TorchRL. The framework is validated through four distinct tasks: station-keeping, circle tracking, helical tracking, and lemniscate tracking. This framework sets the stage for advancing RL in underwater robotics and facilitating efficient training in complex, dynamic environments. |
| title | MarineGym: Accelerated Training for Underwater Vehicles with High-Fidelity RL Simulation |
| topic | Robotics |
| url | https://arxiv.org/abs/2410.14117 |