Navigating Motion Agents in Dynamic and Cluttered Environments through LLM Reasoning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhao, Yubo, Wu, Qi, Wang, Yifan, Tai, Yu-Wing, Tang, Chi-Keung
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909638209830912
author Zhao, Yubo
Wu, Qi
Wang, Yifan
Tai, Yu-Wing
Tang, Chi-Keung
author_facet Zhao, Yubo
Wu, Qi
Wang, Yifan
Tai, Yu-Wing
Tang, Chi-Keung
contents This paper advances motion agents empowered by large language models (LLMs) toward autonomous navigation in dynamic and cluttered environments, significantly surpassing first and recent seminal but limited studies on LLM's spatial reasoning, where movements are restricted in four directions in simple, static environments in the presence of only single agents much less multiple agents. Specifically, we investigate LLMs as spatial reasoners to overcome these limitations by uniformly encoding environments (e.g., real indoor floorplans), agents which can be dynamic obstacles and their paths as discrete tokens akin to language tokens. Our training-free framework supports multi-agent coordination, closed-loop replanning, and dynamic obstacle avoidance without retraining or fine-tuning. We show that LLMs can generalize across agents, tasks, and environments using only text-based interactions, opening new possibilities for semantically grounded, interactive navigation in both simulation and embodied systems.
format Preprint
id arxiv_https___arxiv_org_abs_2503_07323
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Navigating Motion Agents in Dynamic and Cluttered Environments through LLM Reasoning
Zhao, Yubo
Wu, Qi
Wang, Yifan
Tai, Yu-Wing
Tang, Chi-Keung
Artificial Intelligence
Computer Vision and Pattern Recognition
Robotics
This paper advances motion agents empowered by large language models (LLMs) toward autonomous navigation in dynamic and cluttered environments, significantly surpassing first and recent seminal but limited studies on LLM's spatial reasoning, where movements are restricted in four directions in simple, static environments in the presence of only single agents much less multiple agents. Specifically, we investigate LLMs as spatial reasoners to overcome these limitations by uniformly encoding environments (e.g., real indoor floorplans), agents which can be dynamic obstacles and their paths as discrete tokens akin to language tokens. Our training-free framework supports multi-agent coordination, closed-loop replanning, and dynamic obstacle avoidance without retraining or fine-tuning. We show that LLMs can generalize across agents, tasks, and environments using only text-based interactions, opening new possibilities for semantically grounded, interactive navigation in both simulation and embodied systems.
title Navigating Motion Agents in Dynamic and Cluttered Environments through LLM Reasoning
topic Artificial Intelligence
Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2503.07323