FlowNav: Combining Flow Matching and Depth Priors for Efficient Navigation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gode, Samiran, Nayak, Abhijeet, Oliveira, Débora N. P., Krawez, Michael, Schmid, Cordelia, Burgard, Wolfram
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909707325669376
author Gode, Samiran
Nayak, Abhijeet
Oliveira, Débora N. P.
Krawez, Michael
Schmid, Cordelia
Burgard, Wolfram
author_facet Gode, Samiran
Nayak, Abhijeet
Oliveira, Débora N. P.
Krawez, Michael
Schmid, Cordelia
Burgard, Wolfram
contents Effective robot navigation in unseen environments is a challenging task that requires precise control actions at high frequencies. Recent advances have framed it as an image-goal-conditioned control problem, where the robot generates navigation actions using frontal RGB images. Current state-of-the-art methods in this area use diffusion policies to generate these control actions. Despite their promising results, these models are computationally expensive and suffer from weak perception. To address these limitations, we present FlowNav, a novel approach that uses a combination of CFM and depth priors from off-the-shelf foundation models to learn action policies for robot navigation. FlowNav is significantly more accurate and faster at navigation and exploration than state-of-the-art methods. We validate our contributions using real robot experiments in multiple environments, demonstrating improved navigation reliability and accuracy. Code and trained models are publicly available.
format Preprint
id arxiv_https___arxiv_org_abs_2411_09524
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle FlowNav: Combining Flow Matching and Depth Priors for Efficient Navigation
Gode, Samiran
Nayak, Abhijeet
Oliveira, Débora N. P.
Krawez, Michael
Schmid, Cordelia
Burgard, Wolfram
Robotics
Effective robot navigation in unseen environments is a challenging task that requires precise control actions at high frequencies. Recent advances have framed it as an image-goal-conditioned control problem, where the robot generates navigation actions using frontal RGB images. Current state-of-the-art methods in this area use diffusion policies to generate these control actions. Despite their promising results, these models are computationally expensive and suffer from weak perception. To address these limitations, we present FlowNav, a novel approach that uses a combination of CFM and depth priors from off-the-shelf foundation models to learn action policies for robot navigation. FlowNav is significantly more accurate and faster at navigation and exploration than state-of-the-art methods. We validate our contributions using real robot experiments in multiple environments, demonstrating improved navigation reliability and accuracy. Code and trained models are publicly available.
title FlowNav: Combining Flow Matching and Depth Priors for Efficient Navigation
topic Robotics
url https://arxiv.org/abs/2411.09524