Can LLMs Learn to Map the World from Local Descriptions?

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xia, Sirui, Chen, Aili, Wang, Xintao, Zhu, Tinghui, Zhang, Yikai, Chen, Jiangjie, Xiao, Yanghua
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918036367212544
author Xia, Sirui
Chen, Aili
Wang, Xintao
Zhu, Tinghui
Zhang, Yikai
Chen, Jiangjie
Xiao, Yanghua
author_facet Xia, Sirui
Chen, Aili
Wang, Xintao
Zhu, Tinghui
Zhang, Yikai
Chen, Jiangjie
Xiao, Yanghua
contents Recent advances in Large Language Models (LLMs) have demonstrated strong capabilities in tasks such as code and mathematics. However, their potential to internalize structured spatial knowledge remains underexplored. This study investigates whether LLMs, grounded in locally relative human observations, can construct coherent global spatial cognition by integrating fragmented relational descriptions. We focus on two core aspects of spatial cognition: spatial perception, where models infer consistent global layouts from local positional relationships, and spatial navigation, where models learn road connectivity from trajectory data and plan optimal paths between unconnected locations. Experiments conducted in a simulated urban environment demonstrate that LLMs not only generalize to unseen spatial relationships between points of interest (POIs) but also exhibit latent representations aligned with real-world spatial distributions. Furthermore, LLMs can learn road connectivity from trajectory descriptions, enabling accurate path planning and dynamic spatial awareness during navigation.
format Preprint
id arxiv_https___arxiv_org_abs_2505_20874
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Can LLMs Learn to Map the World from Local Descriptions?
Xia, Sirui
Chen, Aili
Wang, Xintao
Zhu, Tinghui
Zhang, Yikai
Chen, Jiangjie
Xiao, Yanghua
Computation and Language
Recent advances in Large Language Models (LLMs) have demonstrated strong capabilities in tasks such as code and mathematics. However, their potential to internalize structured spatial knowledge remains underexplored. This study investigates whether LLMs, grounded in locally relative human observations, can construct coherent global spatial cognition by integrating fragmented relational descriptions. We focus on two core aspects of spatial cognition: spatial perception, where models infer consistent global layouts from local positional relationships, and spatial navigation, where models learn road connectivity from trajectory data and plan optimal paths between unconnected locations. Experiments conducted in a simulated urban environment demonstrate that LLMs not only generalize to unseen spatial relationships between points of interest (POIs) but also exhibit latent representations aligned with real-world spatial distributions. Furthermore, LLMs can learn road connectivity from trajectory descriptions, enabling accurate path planning and dynamic spatial awareness during navigation.
title Can LLMs Learn to Map the World from Local Descriptions?
topic Computation and Language
url https://arxiv.org/abs/2505.20874