The System Description of CPS Team for Track on Driving with Language of CVPR 2024 Autonomous Grand Challenge
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911153243815936 |
|---|---|
| author | Peng, Jinghan Wang, Jingwen Yu, Xing Du, Dehui |
| author_facet | Peng, Jinghan Wang, Jingwen Yu, Xing Du, Dehui |
| contents | This report outlines our approach using vision language model systems for the Driving with Language track of the CVPR 2024 Autonomous Grand Challenge. We have exclusively utilized the DriveLM-nuScenes dataset for training our models. Our systems are built on the LLaVA models, which we enhanced through fine-tuning with the LoRA and DoRA methods. Additionally, we have integrated depth information from open-source depth estimation models to enrich the training and inference processes. For inference, particularly with multiple-choice and yes/no questions, we adopted a Chain-of-Thought reasoning approach to improve the accuracy of the results. This comprehensive methodology enabled us to achieve a top score of 0.7799 on the validation set leaderboard, ranking 1st on the leaderboard. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_11071 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | The System Description of CPS Team for Track on Driving with Language of CVPR 2024 Autonomous Grand Challenge Peng, Jinghan Wang, Jingwen Yu, Xing Du, Dehui Computer Vision and Pattern Recognition Artificial Intelligence Computation and Language This report outlines our approach using vision language model systems for the Driving with Language track of the CVPR 2024 Autonomous Grand Challenge. We have exclusively utilized the DriveLM-nuScenes dataset for training our models. Our systems are built on the LLaVA models, which we enhanced through fine-tuning with the LoRA and DoRA methods. Additionally, we have integrated depth information from open-source depth estimation models to enrich the training and inference processes. For inference, particularly with multiple-choice and yes/no questions, we adopted a Chain-of-Thought reasoning approach to improve the accuracy of the results. This comprehensive methodology enabled us to achieve a top score of 0.7799 on the validation set leaderboard, ranking 1st on the leaderboard. |
| title | The System Description of CPS Team for Track on Driving with Language of CVPR 2024 Autonomous Grand Challenge |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2509.11071 |