Salvato in:
Dettagli Bibliografici
Autori principali: Katz, Michael, Kokel, Harsha, Muise, Christian, Sohrabi, Shirin, Sreedharan, Sarath
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:https://arxiv.org/abs/2505.21674
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908381944479744
author Katz, Michael
Kokel, Harsha
Muise, Christian
Sohrabi, Shirin
Sreedharan, Sarath
author_facet Katz, Michael
Kokel, Harsha
Muise, Christian
Sohrabi, Shirin
Sreedharan, Sarath
contents In over sixty years since its inception, the field of planning has made significant contributions to both the theory and practice of building planning software that can solve a never-before-seen planning problem. This was done through established practices of rigorous design and evaluation of planning systems. It is our position that this rigor should be applied to the current trend of work on planning with large language models. One way to do so is by correctly incorporating the insights, tools, and data from the automated planning community into the design and evaluation of LLM-based planners. The experience and expertise of the planning community are not just important from a historical perspective; the lessons learned could play a crucial role in accelerating the development of LLM-based planners. This position is particularly important in light of the abundance of recent works that replicate and propagate the same pitfalls that the planning community has encountered and learned from. We believe that avoiding such known pitfalls will contribute greatly to the progress in building LLM-based planners and to planning in general.
format Preprint
id arxiv_https___arxiv_org_abs_2505_21674
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Make Planning Research Rigorous Again!
Katz, Michael
Kokel, Harsha
Muise, Christian
Sohrabi, Shirin
Sreedharan, Sarath
Artificial Intelligence
In over sixty years since its inception, the field of planning has made significant contributions to both the theory and practice of building planning software that can solve a never-before-seen planning problem. This was done through established practices of rigorous design and evaluation of planning systems. It is our position that this rigor should be applied to the current trend of work on planning with large language models. One way to do so is by correctly incorporating the insights, tools, and data from the automated planning community into the design and evaluation of LLM-based planners. The experience and expertise of the planning community are not just important from a historical perspective; the lessons learned could play a crucial role in accelerating the development of LLM-based planners. This position is particularly important in light of the abundance of recent works that replicate and propagate the same pitfalls that the planning community has encountered and learned from. We believe that avoiding such known pitfalls will contribute greatly to the progress in building LLM-based planners and to planning in general.
title Make Planning Research Rigorous Again!
topic Artificial Intelligence
url https://arxiv.org/abs/2505.21674