DRAMA: An Efficient End-to-end Motion Planner for Autonomous Driving with Mamba
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917748149321728 |
|---|---|
| author | Yuan, Chengran Zhang, Zhanqi Sun, Jiawei Sun, Shuo Huang, Zefan Lee, Christina Dao Wen Li, Dongen Han, Yuhang Wong, Anthony Tee, Keng Peng Ang Jr, Marcelo H. |
| author_facet | Yuan, Chengran Zhang, Zhanqi Sun, Jiawei Sun, Shuo Huang, Zefan Lee, Christina Dao Wen Li, Dongen Han, Yuhang Wong, Anthony Tee, Keng Peng Ang Jr, Marcelo H. |
| contents | Motion planning is a challenging task to generate safe and feasible trajectories in highly dynamic and complex environments, forming a core capability for autonomous vehicles. In this paper, we propose DRAMA, the first Mamba-based end-to-end motion planner for autonomous vehicles. DRAMA fuses camera, LiDAR Bird's Eye View images in the feature space, as well as ego status information, to generate a series of future ego trajectories. Unlike traditional transformer-based methods with quadratic attention complexity for sequence length, DRAMA is able to achieve a less computationally intensive attention complexity, demonstrating potential to deal with increasingly complex scenarios. Leveraging our Mamba fusion module, DRAMA efficiently and effectively fuses the features of the camera and LiDAR modalities. In addition, we introduce a Mamba-Transformer decoder that enhances the overall planning performance. This module is universally adaptable to any Transformer-based model, especially for tasks with long sequence inputs. We further introduce a novel feature state dropout which improves the planner's robustness without increasing training and inference times. Extensive experimental results show that DRAMA achieves higher accuracy on the NAVSIM dataset compared to the baseline Transfuser, with fewer parameters and lower computational costs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_03601 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | DRAMA: An Efficient End-to-end Motion Planner for Autonomous Driving with Mamba Yuan, Chengran Zhang, Zhanqi Sun, Jiawei Sun, Shuo Huang, Zefan Lee, Christina Dao Wen Li, Dongen Han, Yuhang Wong, Anthony Tee, Keng Peng Ang Jr, Marcelo H. Robotics Motion planning is a challenging task to generate safe and feasible trajectories in highly dynamic and complex environments, forming a core capability for autonomous vehicles. In this paper, we propose DRAMA, the first Mamba-based end-to-end motion planner for autonomous vehicles. DRAMA fuses camera, LiDAR Bird's Eye View images in the feature space, as well as ego status information, to generate a series of future ego trajectories. Unlike traditional transformer-based methods with quadratic attention complexity for sequence length, DRAMA is able to achieve a less computationally intensive attention complexity, demonstrating potential to deal with increasingly complex scenarios. Leveraging our Mamba fusion module, DRAMA efficiently and effectively fuses the features of the camera and LiDAR modalities. In addition, we introduce a Mamba-Transformer decoder that enhances the overall planning performance. This module is universally adaptable to any Transformer-based model, especially for tasks with long sequence inputs. We further introduce a novel feature state dropout which improves the planner's robustness without increasing training and inference times. Extensive experimental results show that DRAMA achieves higher accuracy on the NAVSIM dataset compared to the baseline Transfuser, with fewer parameters and lower computational costs. |
| title | DRAMA: An Efficient End-to-end Motion Planner for Autonomous Driving with Mamba |
| topic | Robotics |
| url | https://arxiv.org/abs/2408.03601 |