Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2411.09971 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915021954482176 |
|---|---|
| author | Yamazaki, Shota Zhang, Chenyu Nanri, Takuya Shigekane, Akio Wang, Siyuan Nishiyama, Jo Chu, Tao Yokosawa, Kohei |
| author_facet | Yamazaki, Shota Zhang, Chenyu Nanri, Takuya Shigekane, Akio Wang, Siyuan Nishiyama, Jo Chu, Tao Yokosawa, Kohei |
| contents | End-to-end style autonomous driving models have been developed recently. These models lack interpretability of decision-making process from perception to control of the ego vehicle, resulting in anxiety for passengers. To alleviate it, it is effective to build a model which outputs captions describing future behaviors of the ego vehicle and their reason. However, the existing approaches generate reasoning text that inadequately reflects the future plans of the ego vehicle, because they train models to output captions using momentary control signals as inputs. In this study, we propose a reasoning model that takes future planning trajectories of the ego vehicle as inputs to solve this limitation with the dataset newly collected. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_09971 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Explanation for Trajectory Planning using Multi-modal Large Language Model for Autonomous Driving Yamazaki, Shota Zhang, Chenyu Nanri, Takuya Shigekane, Akio Wang, Siyuan Nishiyama, Jo Chu, Tao Yokosawa, Kohei Computer Vision and Pattern Recognition Robotics End-to-end style autonomous driving models have been developed recently. These models lack interpretability of decision-making process from perception to control of the ego vehicle, resulting in anxiety for passengers. To alleviate it, it is effective to build a model which outputs captions describing future behaviors of the ego vehicle and their reason. However, the existing approaches generate reasoning text that inadequately reflects the future plans of the ego vehicle, because they train models to output captions using momentary control signals as inputs. In this study, we propose a reasoning model that takes future planning trajectories of the ego vehicle as inputs to solve this limitation with the dataset newly collected. |
| title | Explanation for Trajectory Planning using Multi-modal Large Language Model for Autonomous Driving |
| topic | Computer Vision and Pattern Recognition Robotics |
| url | https://arxiv.org/abs/2411.09971 |