ZeST: an LLM-based Zero-Shot Traversability Navigation for Unknown Environments

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Gummadi, Shreya, Gasparino, Mateus V., Capezzuto, Gianluca, Becker, Marcelo, Chowdhary, Girish
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912656476078080
author Gummadi, Shreya
Gasparino, Mateus V.
Capezzuto, Gianluca
Becker, Marcelo
Chowdhary, Girish
author_facet Gummadi, Shreya
Gasparino, Mateus V.
Capezzuto, Gianluca
Becker, Marcelo
Chowdhary, Girish
contents The advancement of robotics and autonomous navigation systems hinges on the ability to accurately predict terrain traversability. Traditional methods for generating datasets to train these prediction models often involve putting robots into potentially hazardous environments, posing risks to equipment and safety. To solve this problem, we present ZeST, a novel approach leveraging visual reasoning capabilities of Large Language Models (LLMs) to create a traversability map in real-time without exposing robots to danger. Our approach not only performs zero-shot traversability and mitigates the risks associated with real-world data collection but also accelerates the development of advanced navigation systems, offering a cost-effective and scalable solution. To support our findings, we present navigation results, in both controlled indoor and unstructured outdoor environments. As shown in the experiments, our method provides safer navigation when compared to other state-of-the-art methods, constantly reaching the final goal.
format Preprint
id arxiv_https___arxiv_org_abs_2508_19131
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ZeST: an LLM-based Zero-Shot Traversability Navigation for Unknown Environments
Gummadi, Shreya
Gasparino, Mateus V.
Capezzuto, Gianluca
Becker, Marcelo
Chowdhary, Girish
Robotics
Artificial Intelligence
Computer Vision and Pattern Recognition
The advancement of robotics and autonomous navigation systems hinges on the ability to accurately predict terrain traversability. Traditional methods for generating datasets to train these prediction models often involve putting robots into potentially hazardous environments, posing risks to equipment and safety. To solve this problem, we present ZeST, a novel approach leveraging visual reasoning capabilities of Large Language Models (LLMs) to create a traversability map in real-time without exposing robots to danger. Our approach not only performs zero-shot traversability and mitigates the risks associated with real-world data collection but also accelerates the development of advanced navigation systems, offering a cost-effective and scalable solution. To support our findings, we present navigation results, in both controlled indoor and unstructured outdoor environments. As shown in the experiments, our method provides safer navigation when compared to other state-of-the-art methods, constantly reaching the final goal.
title ZeST: an LLM-based Zero-Shot Traversability Navigation for Unknown Environments
topic Robotics
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2508.19131