DeCoNav: Dialog enhanced Long-Horizon Collaborative Vision-Language Navigation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhou, Sunyao, Wu, Yunzi, Wang, Tianhang, Li, Xinhai, Chen, Guang, Liu, Lizheng, Bai, Chenjia, Li, Xuelong
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910128495656960
author Zhou, Sunyao
Wu, Yunzi
Wang, Tianhang
Li, Xinhai
Chen, Guang
Liu, Lizheng
Bai, Chenjia
Li, Xuelong
author_facet Zhou, Sunyao
Wu, Yunzi
Wang, Tianhang
Li, Xinhai
Chen, Guang
Liu, Lizheng
Bai, Chenjia
Li, Xuelong
contents Long-horizon collaborative vision-language navigation (VLN) is critical for multi-robot systems to accomplish complex tasks beyond the capability of a single agent. CoNavBench takes a first step by introducing the first collaborative long-horizon VLN benchmark with relay-style multi-robot tasks, a collaboration taxonomy, along with graph-grounded generation and evaluation to model handoffs and rendezvous in shared environments. However, existing benchmarks and evaluations often do not enforce strictly synchronized dual-robot rollout on a shared world timeline, and they typically rely on static coordination policies that cannot adapt when new cross-agent evidence emerges. We present Dialog enhanced Long-Horizon Collaborative Vision-Language Navigation (DeCoNav), a decentralized framework that couples event-triggered dialogue with dynamic task allocation and replanning for real-time, adaptive coordination. In DeCoNav, robots exchange compact semantic states via dialogue without a central controller. When informative events such as new evidence, uncertainty, or conflicts arise, dialogue is triggered to dynamically reassign subgoals and replan under synchronized execution. Implemented in DeCoNavBench with 1,213 tasks across 176 HM3D scenes, DeCoNav improves the both-success rate (BSR) by 69.2%, demonstrating the effectiveness of dialogue-driven, dynamically reallocated planning for multi-robot collaboration.
format Preprint
id arxiv_https___arxiv_org_abs_2604_12486
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle DeCoNav: Dialog enhanced Long-Horizon Collaborative Vision-Language Navigation
Zhou, Sunyao
Wu, Yunzi
Wang, Tianhang
Li, Xinhai
Chen, Guang
Liu, Lizheng
Bai, Chenjia
Li, Xuelong
Robotics
Long-horizon collaborative vision-language navigation (VLN) is critical for multi-robot systems to accomplish complex tasks beyond the capability of a single agent. CoNavBench takes a first step by introducing the first collaborative long-horizon VLN benchmark with relay-style multi-robot tasks, a collaboration taxonomy, along with graph-grounded generation and evaluation to model handoffs and rendezvous in shared environments. However, existing benchmarks and evaluations often do not enforce strictly synchronized dual-robot rollout on a shared world timeline, and they typically rely on static coordination policies that cannot adapt when new cross-agent evidence emerges. We present Dialog enhanced Long-Horizon Collaborative Vision-Language Navigation (DeCoNav), a decentralized framework that couples event-triggered dialogue with dynamic task allocation and replanning for real-time, adaptive coordination. In DeCoNav, robots exchange compact semantic states via dialogue without a central controller. When informative events such as new evidence, uncertainty, or conflicts arise, dialogue is triggered to dynamically reassign subgoals and replan under synchronized execution. Implemented in DeCoNavBench with 1,213 tasks across 176 HM3D scenes, DeCoNav improves the both-success rate (BSR) by 69.2%, demonstrating the effectiveness of dialogue-driven, dynamically reallocated planning for multi-robot collaboration.
title DeCoNav: Dialog enhanced Long-Horizon Collaborative Vision-Language Navigation
topic Robotics
url https://arxiv.org/abs/2604.12486