NavigScene: Bridging Local Perception and Global Navigation for Beyond-Visual-Range Autonomous Driving
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866914127216115712 |
|---|---|
| author | Peng, Qucheng Bai, Chen Zhang, Guoxiang Xu, Bo Liu, Xiaotong Zheng, Xiaoyin Chen, Chen Lu, Cheng |
| author_facet | Peng, Qucheng Bai, Chen Zhang, Guoxiang Xu, Bo Liu, Xiaotong Zheng, Xiaoyin Chen, Chen Lu, Cheng |
| contents | Autonomous driving systems have made significant advances in Q&A, perception, prediction, and planning based on local visual information, yet they struggle to incorporate broader navigational context that human drivers routinely utilize. We address this critical gap between local sensor data and global navigation information by proposing NavigScene, an auxiliary navigation-guided natural language dataset that simulates a human-like driving environment within autonomous driving systems. Moreover, we develop three complementary paradigms to leverage NavigScene: (1) Navigation-guided Reasoning, which enhances vision-language models by incorporating navigation context into the prompting approach; (2) Navigation-guided Preference Optimization, a reinforcement learning method that extends Direct Preference Optimization to improve vision-language model responses by establishing preferences for navigation-relevant summarized information; and (3) Navigation-guided Vision-Language-Action model, which integrates navigation guidance and vision-language models with conventional driving models through feature fusion. Extensive experiments demonstrate that our approaches significantly improve performance across perception, prediction, planning, and question-answering tasks by enabling reasoning capabilities beyond visual range and improving generalization to diverse driving scenarios. This work represents a significant step toward more comprehensive autonomous driving systems capable of navigating complex, unfamiliar environments with greater reliability and safety. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_05227 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | NavigScene: Bridging Local Perception and Global Navigation for Beyond-Visual-Range Autonomous Driving Peng, Qucheng Bai, Chen Zhang, Guoxiang Xu, Bo Liu, Xiaotong Zheng, Xiaoyin Chen, Chen Lu, Cheng Robotics Computer Vision and Pattern Recognition Machine Learning Multimedia Systems and Control Autonomous driving systems have made significant advances in Q&A, perception, prediction, and planning based on local visual information, yet they struggle to incorporate broader navigational context that human drivers routinely utilize. We address this critical gap between local sensor data and global navigation information by proposing NavigScene, an auxiliary navigation-guided natural language dataset that simulates a human-like driving environment within autonomous driving systems. Moreover, we develop three complementary paradigms to leverage NavigScene: (1) Navigation-guided Reasoning, which enhances vision-language models by incorporating navigation context into the prompting approach; (2) Navigation-guided Preference Optimization, a reinforcement learning method that extends Direct Preference Optimization to improve vision-language model responses by establishing preferences for navigation-relevant summarized information; and (3) Navigation-guided Vision-Language-Action model, which integrates navigation guidance and vision-language models with conventional driving models through feature fusion. Extensive experiments demonstrate that our approaches significantly improve performance across perception, prediction, planning, and question-answering tasks by enabling reasoning capabilities beyond visual range and improving generalization to diverse driving scenarios. This work represents a significant step toward more comprehensive autonomous driving systems capable of navigating complex, unfamiliar environments with greater reliability and safety. |
| title | NavigScene: Bridging Local Perception and Global Navigation for Beyond-Visual-Range Autonomous Driving |
| topic | Robotics Computer Vision and Pattern Recognition Machine Learning Multimedia Systems and Control |
| url | https://arxiv.org/abs/2507.05227 |