RMP-YOLO: A Robust Motion Predictor for Partially Observable Scenarios even if You Only Look Once
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918064876945408 |
|---|---|
| author | Sun, Jiawei Li, Jiahui Liu, Tingchen Yuan, Chengran Sun, Shuo Huang, Zefan Wong, Anthony Tee, Keng Peng Ang Jr, Marcelo H. |
| author_facet | Sun, Jiawei Li, Jiahui Liu, Tingchen Yuan, Chengran Sun, Shuo Huang, Zefan Wong, Anthony Tee, Keng Peng Ang Jr, Marcelo H. |
| contents | We introduce RMP-YOLO, a unified framework designed to provide robust motion predictions even with incomplete input data. Our key insight stems from the observation that complete and reliable historical trajectory data plays a pivotal role in ensuring accurate motion prediction. Therefore, we propose a new paradigm that prioritizes the reconstruction of intact historical trajectories before feeding them into the prediction modules. Our approach introduces a novel scene tokenization module to enhance the extraction and fusion of spatial and temporal features. Following this, our proposed recovery module reconstructs agents' incomplete historical trajectories by leveraging local map topology and interactions with nearby agents. The reconstructed, clean historical data is then integrated into the downstream prediction modules. Our framework is able to effectively handle missing data of varying lengths and remains robust against observation noise, while maintaining high prediction accuracy. Furthermore, our recovery module is compatible with existing prediction models, ensuring seamless integration. Extensive experiments validate the effectiveness of our approach, and deployment in real-world autonomous vehicles confirms its practical utility. In the 2024 Waymo Motion Prediction Competition, our method, RMP-YOLO, achieves state-of-the-art performance, securing third place. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_11696 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | RMP-YOLO: A Robust Motion Predictor for Partially Observable Scenarios even if You Only Look Once Sun, Jiawei Li, Jiahui Liu, Tingchen Yuan, Chengran Sun, Shuo Huang, Zefan Wong, Anthony Tee, Keng Peng Ang Jr, Marcelo H. Robotics We introduce RMP-YOLO, a unified framework designed to provide robust motion predictions even with incomplete input data. Our key insight stems from the observation that complete and reliable historical trajectory data plays a pivotal role in ensuring accurate motion prediction. Therefore, we propose a new paradigm that prioritizes the reconstruction of intact historical trajectories before feeding them into the prediction modules. Our approach introduces a novel scene tokenization module to enhance the extraction and fusion of spatial and temporal features. Following this, our proposed recovery module reconstructs agents' incomplete historical trajectories by leveraging local map topology and interactions with nearby agents. The reconstructed, clean historical data is then integrated into the downstream prediction modules. Our framework is able to effectively handle missing data of varying lengths and remains robust against observation noise, while maintaining high prediction accuracy. Furthermore, our recovery module is compatible with existing prediction models, ensuring seamless integration. Extensive experiments validate the effectiveness of our approach, and deployment in real-world autonomous vehicles confirms its practical utility. In the 2024 Waymo Motion Prediction Competition, our method, RMP-YOLO, achieves state-of-the-art performance, securing third place. |
| title | RMP-YOLO: A Robust Motion Predictor for Partially Observable Scenarios even if You Only Look Once |
| topic | Robotics |
| url | https://arxiv.org/abs/2409.11696 |