SayCanPay: Heuristic Planning with Large Language Models using Learnable Domain Knowledge

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Hazra, Rishi, Martires, Pedro Zuidberg Dos, De Raedt, Luc
Natura: Preprint
Pubblicazione: 2023
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911744880803840
author Hazra, Rishi
Martires, Pedro Zuidberg Dos
De Raedt, Luc
author_facet Hazra, Rishi
Martires, Pedro Zuidberg Dos
De Raedt, Luc
contents Large Language Models (LLMs) have demonstrated impressive planning abilities due to their vast "world knowledge". Yet, obtaining plans that are both feasible (grounded in affordances) and cost-effective (in plan length), remains a challenge, despite recent progress. This contrasts with heuristic planning methods that employ domain knowledge (formalized in action models such as PDDL) and heuristic search to generate feasible, optimal plans. Inspired by this, we propose to combine the power of LLMs and heuristic planning by leveraging the world knowledge of LLMs and the principles of heuristic search. Our approach, SayCanPay, employs LLMs to generate actions (Say) guided by learnable domain knowledge, that evaluates actions' feasibility (Can) and long-term reward/payoff (Pay), and heuristic search to select the best sequence of actions. Our contributions are (1) a novel framing of the LLM planning problem in the context of heuristic planning, (2) integrating grounding and cost-effective elements into the generated plans, and (3) using heuristic search over actions. Our extensive evaluations show that our model surpasses other LLM planning approaches.
format Preprint
id arxiv_https___arxiv_org_abs_2308_12682
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle SayCanPay: Heuristic Planning with Large Language Models using Learnable Domain Knowledge
Hazra, Rishi
Martires, Pedro Zuidberg Dos
De Raedt, Luc
Artificial Intelligence
Large Language Models (LLMs) have demonstrated impressive planning abilities due to their vast "world knowledge". Yet, obtaining plans that are both feasible (grounded in affordances) and cost-effective (in plan length), remains a challenge, despite recent progress. This contrasts with heuristic planning methods that employ domain knowledge (formalized in action models such as PDDL) and heuristic search to generate feasible, optimal plans. Inspired by this, we propose to combine the power of LLMs and heuristic planning by leveraging the world knowledge of LLMs and the principles of heuristic search. Our approach, SayCanPay, employs LLMs to generate actions (Say) guided by learnable domain knowledge, that evaluates actions' feasibility (Can) and long-term reward/payoff (Pay), and heuristic search to select the best sequence of actions. Our contributions are (1) a novel framing of the LLM planning problem in the context of heuristic planning, (2) integrating grounding and cost-effective elements into the generated plans, and (3) using heuristic search over actions. Our extensive evaluations show that our model surpasses other LLM planning approaches.
title SayCanPay: Heuristic Planning with Large Language Models using Learnable Domain Knowledge
topic Artificial Intelligence
url https://arxiv.org/abs/2308.12682