UNCAP: Uncertainty-Guided Neurosymbolic Planning Using Natural Language Communication for Cooperative Autonomous Vehicles

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Bhatt, Neel P., Li, Po-han, Gupta, Kushagra, Siva, Rohan, Milan, Daniel, Hogue, Alexander T., Chinchali, Sandeep P., Fridovich-Keil, David, Wang, Zhangyang, Topcu, Ufuk
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917197871316992
author Bhatt, Neel P.
Li, Po-han
Gupta, Kushagra
Siva, Rohan
Milan, Daniel
Hogue, Alexander T.
Chinchali, Sandeep P.
Fridovich-Keil, David
Wang, Zhangyang
Topcu, Ufuk
author_facet Bhatt, Neel P.
Li, Po-han
Gupta, Kushagra
Siva, Rohan
Milan, Daniel
Hogue, Alexander T.
Chinchali, Sandeep P.
Fridovich-Keil, David
Wang, Zhangyang
Topcu, Ufuk
contents Safe large-scale coordination of multiple cooperative connected autonomous vehicles (CAVs) hinges on communication that is both efficient and interpretable. Existing approaches either rely on transmitting high-bandwidth raw sensor data streams or neglect perception and planning uncertainties inherent in shared data, resulting in systems that are neither scalable nor safe. To address these limitations, we propose Uncertainty-Guided Natural Language Cooperative Autonomous Planning (UNCAP), a vision-language model-based planning approach that enables CAVs to communicate via lightweight natural language messages while explicitly accounting for perception uncertainty in decision-making. UNCAP features a two-stage communication protocol: (i) an ego CAV first identifies the subset of vehicles most relevant for information exchange, and (ii) the selected CAVs then transmit messages that quantitatively express their perception uncertainty. By selectively fusing messages that maximize mutual information, this strategy allows the ego vehicle to integrate only the most relevant signals into its decision-making, improving both the scalability and reliability of cooperative planning. Experiments across diverse driving scenarios show a 63% reduction in communication bandwidth with a 31% increase in driving safety score, a 61% reduction in decision uncertainty, and a four-fold increase in collision distance margin during near-miss events. Project website: https://uncap-project.github.io/
format Preprint
id arxiv_https___arxiv_org_abs_2510_12992
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle UNCAP: Uncertainty-Guided Neurosymbolic Planning Using Natural Language Communication for Cooperative Autonomous Vehicles
Bhatt, Neel P.
Li, Po-han
Gupta, Kushagra
Siva, Rohan
Milan, Daniel
Hogue, Alexander T.
Chinchali, Sandeep P.
Fridovich-Keil, David
Wang, Zhangyang
Topcu, Ufuk
Robotics
Computation and Language
Computer Vision and Pattern Recognition
Multiagent Systems
Safe large-scale coordination of multiple cooperative connected autonomous vehicles (CAVs) hinges on communication that is both efficient and interpretable. Existing approaches either rely on transmitting high-bandwidth raw sensor data streams or neglect perception and planning uncertainties inherent in shared data, resulting in systems that are neither scalable nor safe. To address these limitations, we propose Uncertainty-Guided Natural Language Cooperative Autonomous Planning (UNCAP), a vision-language model-based planning approach that enables CAVs to communicate via lightweight natural language messages while explicitly accounting for perception uncertainty in decision-making. UNCAP features a two-stage communication protocol: (i) an ego CAV first identifies the subset of vehicles most relevant for information exchange, and (ii) the selected CAVs then transmit messages that quantitatively express their perception uncertainty. By selectively fusing messages that maximize mutual information, this strategy allows the ego vehicle to integrate only the most relevant signals into its decision-making, improving both the scalability and reliability of cooperative planning. Experiments across diverse driving scenarios show a 63% reduction in communication bandwidth with a 31% increase in driving safety score, a 61% reduction in decision uncertainty, and a four-fold increase in collision distance margin during near-miss events. Project website: https://uncap-project.github.io/
title UNCAP: Uncertainty-Guided Neurosymbolic Planning Using Natural Language Communication for Cooperative Autonomous Vehicles
topic Robotics
Computation and Language
Computer Vision and Pattern Recognition
Multiagent Systems
url https://arxiv.org/abs/2510.12992