Navigate Complex Physical Worlds via Geometrically Constrained LLM

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Huang, Yongqiang, Ye, Wentao, Li, Liyao, Zhao, Junbo
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912083240550400
author Huang, Yongqiang
Ye, Wentao
Li, Liyao
Zhao, Junbo
author_facet Huang, Yongqiang
Ye, Wentao
Li, Liyao
Zhao, Junbo
contents This study investigates the potential of Large Language Models (LLMs) for reconstructing and constructing the physical world solely based on textual knowledge. It explores the impact of model performance on spatial understanding abilities. To enhance the comprehension of geometric and spatial relationships in the complex physical world, the study introduces a set of geometric conventions and develops a workflow based on multi-layer graphs and multi-agent system frameworks. It examines how LLMs achieve multi-step and multi-objective geometric inference in a spatial environment using multi-layer graphs under unified geometric conventions. Additionally, the study employs a genetic algorithm, inspired by large-scale model knowledge, to solve geometric constraint problems. In summary, this work innovatively explores the feasibility of using text-based LLMs as physical world builders and designs a workflow to enhance their capabilities.
format Preprint
id arxiv_https___arxiv_org_abs_2410_17529
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Navigate Complex Physical Worlds via Geometrically Constrained LLM
Huang, Yongqiang
Ye, Wentao
Li, Liyao
Zhao, Junbo
Computation and Language
This study investigates the potential of Large Language Models (LLMs) for reconstructing and constructing the physical world solely based on textual knowledge. It explores the impact of model performance on spatial understanding abilities. To enhance the comprehension of geometric and spatial relationships in the complex physical world, the study introduces a set of geometric conventions and develops a workflow based on multi-layer graphs and multi-agent system frameworks. It examines how LLMs achieve multi-step and multi-objective geometric inference in a spatial environment using multi-layer graphs under unified geometric conventions. Additionally, the study employs a genetic algorithm, inspired by large-scale model knowledge, to solve geometric constraint problems. In summary, this work innovatively explores the feasibility of using text-based LLMs as physical world builders and designs a workflow to enhance their capabilities.
title Navigate Complex Physical Worlds via Geometrically Constrained LLM
topic Computation and Language
url https://arxiv.org/abs/2410.17529