DR-MPC: Deep Residual Model Predictive Control for Real-world Social Navigation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917922049359872 |
|---|---|
| author | Han, James R. Thomas, Hugues Zhang, Jian Rhinehart, Nicholas Barfoot, Timothy D. |
| author_facet | Han, James R. Thomas, Hugues Zhang, Jian Rhinehart, Nicholas Barfoot, Timothy D. |
| contents | How can a robot safely navigate around people with complex motion patterns? Deep Reinforcement Learning (DRL) in simulation holds some promise, but much prior work relies on simulators that fail to capture the nuances of real human motion. Thus, we propose Deep Residual Model Predictive Control (DR-MPC) to enable robots to quickly and safely perform DRL from real-world crowd navigation data. By blending MPC with model-free DRL, DR-MPC overcomes the DRL challenges of large data requirements and unsafe initial behavior. DR-MPC is initialized with MPC-based path tracking, and gradually learns to interact more effectively with humans. To further accelerate learning, a safety component estimates out-of-distribution states to guide the robot away from likely collisions. In simulation, we show that DR-MPC substantially outperforms prior work, including traditional DRL and residual DRL models. Hardware experiments show our approach successfully enables a robot to navigate a variety of crowded situations with few errors using less than 4 hours of training data. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_10646 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | DR-MPC: Deep Residual Model Predictive Control for Real-world Social Navigation Han, James R. Thomas, Hugues Zhang, Jian Rhinehart, Nicholas Barfoot, Timothy D. Robotics Artificial Intelligence Machine Learning How can a robot safely navigate around people with complex motion patterns? Deep Reinforcement Learning (DRL) in simulation holds some promise, but much prior work relies on simulators that fail to capture the nuances of real human motion. Thus, we propose Deep Residual Model Predictive Control (DR-MPC) to enable robots to quickly and safely perform DRL from real-world crowd navigation data. By blending MPC with model-free DRL, DR-MPC overcomes the DRL challenges of large data requirements and unsafe initial behavior. DR-MPC is initialized with MPC-based path tracking, and gradually learns to interact more effectively with humans. To further accelerate learning, a safety component estimates out-of-distribution states to guide the robot away from likely collisions. In simulation, we show that DR-MPC substantially outperforms prior work, including traditional DRL and residual DRL models. Hardware experiments show our approach successfully enables a robot to navigate a variety of crowded situations with few errors using less than 4 hours of training data. |
| title | DR-MPC: Deep Residual Model Predictive Control for Real-world Social Navigation |
| topic | Robotics Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2410.10646 |