BEV-VLM: Trajectory Planning via Unified BEV Abstraction

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Chen, Guancheng, Yang, Sheng, Zhan, Tong, Wang, Jian
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866918358800138240
author Chen, Guancheng
Yang, Sheng
Zhan, Tong
Wang, Jian
author_facet Chen, Guancheng
Yang, Sheng
Zhan, Tong
Wang, Jian
contents This paper introduces BEV-VLM, a novel approach for trajectory planning in autonomous driving that leverages Vision-Language Models (VLMs) with Bird's-Eye View (BEV) feature maps as visual input. Unlike conventional trajectory planning approaches that rely solely on raw visual data (e.g., camera images), our method utilizes a highly compressed and informative BEV representation generated by fusing camera and LiDAR data, with subsequent alignment to High-Definition (HD) maps. This unified BEV-HD map format provides a geometrically consistent and semantically rich scene description, which enables VLMs to perform accurate and robust trajectory planning. Experimental results on the nuScenes dataset demonstrate that, compared with state-of-the-art vision-only methods, our approach achieves a 53.1% improvement in planning accuracy and realizes complete collision avoidance in evaluation scenarios. Our work highlights that VLMs can effectively interpret processed visual representations such as BEV features, expanding their applicability beyond raw image inputs for the task of trajectory planning.
format Preprint
id arxiv_https___arxiv_org_abs_2509_25249
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle BEV-VLM: Trajectory Planning via Unified BEV Abstraction
Chen, Guancheng
Yang, Sheng
Zhan, Tong
Wang, Jian
Robotics
Artificial Intelligence
This paper introduces BEV-VLM, a novel approach for trajectory planning in autonomous driving that leverages Vision-Language Models (VLMs) with Bird's-Eye View (BEV) feature maps as visual input. Unlike conventional trajectory planning approaches that rely solely on raw visual data (e.g., camera images), our method utilizes a highly compressed and informative BEV representation generated by fusing camera and LiDAR data, with subsequent alignment to High-Definition (HD) maps. This unified BEV-HD map format provides a geometrically consistent and semantically rich scene description, which enables VLMs to perform accurate and robust trajectory planning. Experimental results on the nuScenes dataset demonstrate that, compared with state-of-the-art vision-only methods, our approach achieves a 53.1% improvement in planning accuracy and realizes complete collision avoidance in evaluation scenarios. Our work highlights that VLMs can effectively interpret processed visual representations such as BEV features, expanding their applicability beyond raw image inputs for the task of trajectory planning.
title BEV-VLM: Trajectory Planning via Unified BEV Abstraction
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2509.25249