LLMs Can Plan Only If We Tell Them

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Sel, Bilgehan, Jia, Ruoxi, Jin, Ming
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917900624855040
author Sel, Bilgehan
Jia, Ruoxi
Jin, Ming
author_facet Sel, Bilgehan
Jia, Ruoxi
Jin, Ming
contents Large language models (LLMs) have demonstrated significant capabilities in natural language processing and reasoning, yet their effectiveness in autonomous planning has been under debate. While existing studies have utilized LLMs with external feedback mechanisms or in controlled environments for planning, these approaches often involve substantial computational and development resources due to the requirement for careful design and iterative backprompting. Moreover, even the most advanced LLMs like GPT-4 struggle to match human performance on standard planning benchmarks, such as the Blocksworld, without additional support. This paper investigates whether LLMs can independently generate long-horizon plans that rival human baselines. Our novel enhancements to Algorithm-of-Thoughts (AoT), which we dub AoT+, help achieve state-of-the-art results in planning benchmarks out-competing prior methods and human baselines all autonomously.
format Preprint
id arxiv_https___arxiv_org_abs_2501_13545
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle LLMs Can Plan Only If We Tell Them
Sel, Bilgehan
Jia, Ruoxi
Jin, Ming
Computation and Language
Artificial Intelligence
Large language models (LLMs) have demonstrated significant capabilities in natural language processing and reasoning, yet their effectiveness in autonomous planning has been under debate. While existing studies have utilized LLMs with external feedback mechanisms or in controlled environments for planning, these approaches often involve substantial computational and development resources due to the requirement for careful design and iterative backprompting. Moreover, even the most advanced LLMs like GPT-4 struggle to match human performance on standard planning benchmarks, such as the Blocksworld, without additional support. This paper investigates whether LLMs can independently generate long-horizon plans that rival human baselines. Our novel enhancements to Algorithm-of-Thoughts (AoT), which we dub AoT+, help achieve state-of-the-art results in planning benchmarks out-competing prior methods and human baselines all autonomously.
title LLMs Can Plan Only If We Tell Them
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2501.13545