CoFL: Continuous Flow Fields for Language-Conditioned Navigation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Liu, Haokun, Ma, Zhaoqi, Chen, Yicheng, Kitagawa, Masaki, Zhang, Wentao, Xiong, Zicen, Li, Jinjie, Zhao, Moju
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908999298842624
author Liu, Haokun
Ma, Zhaoqi
Chen, Yicheng
Kitagawa, Masaki
Zhang, Wentao
Xiong, Zicen
Li, Jinjie
Zhao, Moju
author_facet Liu, Haokun
Ma, Zhaoqi
Chen, Yicheng
Kitagawa, Masaki
Zhang, Wentao
Xiong, Zicen
Li, Jinjie
Zhao, Moju
contents Existing language-conditioned navigation systems typically rely on modular pipelines or trajectory generators, but the latter use each scene--instruction annotation mainly to supervise one start-conditioned rollout. To address these limitations, we present CoFL, an end-to-end policy that maps a bird's-eye view (BEV) observation and a language instruction to a continuous flow field for navigation. CoFL reformulates navigation as workspace-conditioned field learning rather than start-conditioned trajectory prediction: it learns local motion vectors at arbitrary BEV locations, turning each scene--instruction annotation into dense spatial control supervision. Trajectories are generated from any start by numerical integration of the predicted field, enabling simple real-time rollout and closed-loop recovery. To enable large-scale training and evaluation, we build a dataset of over 500k BEV image--instruction pairs, each procedurally annotated with a flow field and a trajectory derived from semantic maps built on Matterport3D and ScanNet. Evaluating on strictly unseen scenes, CoFL significantly outperforms modular Vision-Language Model (VLM)-based planners and trajectory generation policies in both navigation precision and safety, while maintaining real-time inference. Finally, we deploy CoFL zero-shot in real-world experiments with BEV observations across multiple layouts, maintaining feasible closed-loop control and a high success rate.
format Preprint
id arxiv_https___arxiv_org_abs_2603_02854
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle CoFL: Continuous Flow Fields for Language-Conditioned Navigation
Liu, Haokun
Ma, Zhaoqi
Chen, Yicheng
Kitagawa, Masaki
Zhang, Wentao
Xiong, Zicen
Li, Jinjie
Zhao, Moju
Robotics
Artificial Intelligence
Existing language-conditioned navigation systems typically rely on modular pipelines or trajectory generators, but the latter use each scene--instruction annotation mainly to supervise one start-conditioned rollout. To address these limitations, we present CoFL, an end-to-end policy that maps a bird's-eye view (BEV) observation and a language instruction to a continuous flow field for navigation. CoFL reformulates navigation as workspace-conditioned field learning rather than start-conditioned trajectory prediction: it learns local motion vectors at arbitrary BEV locations, turning each scene--instruction annotation into dense spatial control supervision. Trajectories are generated from any start by numerical integration of the predicted field, enabling simple real-time rollout and closed-loop recovery. To enable large-scale training and evaluation, we build a dataset of over 500k BEV image--instruction pairs, each procedurally annotated with a flow field and a trajectory derived from semantic maps built on Matterport3D and ScanNet. Evaluating on strictly unseen scenes, CoFL significantly outperforms modular Vision-Language Model (VLM)-based planners and trajectory generation policies in both navigation precision and safety, while maintaining real-time inference. Finally, we deploy CoFL zero-shot in real-world experiments with BEV observations across multiple layouts, maintaining feasible closed-loop control and a high success rate.
title CoFL: Continuous Flow Fields for Language-Conditioned Navigation
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2603.02854