Anticipate & Act : Integrating LLMs and Classical Planning for Efficient Task Execution in Household Environments

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Arora, Raghav, Singh, Shivam, Swaminathan, Karthik, Datta, Ahana, Banerjee, Snehasis, Bhowmick, Brojeshwar, Jatavallabhula, Krishna Murthy, Sridharan, Mohan, Krishna, Madhava
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866929698210054144
author Arora, Raghav
Singh, Shivam
Swaminathan, Karthik
Datta, Ahana
Banerjee, Snehasis
Bhowmick, Brojeshwar
Jatavallabhula, Krishna Murthy
Sridharan, Mohan
Krishna, Madhava
author_facet Arora, Raghav
Singh, Shivam
Swaminathan, Karthik
Datta, Ahana
Banerjee, Snehasis
Bhowmick, Brojeshwar
Jatavallabhula, Krishna Murthy
Sridharan, Mohan
Krishna, Madhava
contents Assistive agents performing household tasks such as making the bed or cooking breakfast often compute and execute actions that accomplish one task at a time. However, efficiency can be improved by anticipating upcoming tasks and computing an action sequence that jointly achieves these tasks. State-of-the-art methods for task anticipation use data-driven deep networks and Large Language Models (LLMs), but they do so at the level of high-level tasks and/or require many training examples. Our framework leverages the generic knowledge of LLMs through a small number of prompts to perform high-level task anticipation, using the anticipated tasks as goals in a classical planning system to compute a sequence of finer-granularity actions that jointly achieve these goals. We ground and evaluate our framework's abilities in realistic scenarios in the VirtualHome environment and demonstrate a 31% reduction in execution time compared with a system that does not consider upcoming tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2502_02066
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Anticipate & Act : Integrating LLMs and Classical Planning for Efficient Task Execution in Household Environments
Arora, Raghav
Singh, Shivam
Swaminathan, Karthik
Datta, Ahana
Banerjee, Snehasis
Bhowmick, Brojeshwar
Jatavallabhula, Krishna Murthy
Sridharan, Mohan
Krishna, Madhava
Robotics
Computation and Language
Machine Learning
Assistive agents performing household tasks such as making the bed or cooking breakfast often compute and execute actions that accomplish one task at a time. However, efficiency can be improved by anticipating upcoming tasks and computing an action sequence that jointly achieves these tasks. State-of-the-art methods for task anticipation use data-driven deep networks and Large Language Models (LLMs), but they do so at the level of high-level tasks and/or require many training examples. Our framework leverages the generic knowledge of LLMs through a small number of prompts to perform high-level task anticipation, using the anticipated tasks as goals in a classical planning system to compute a sequence of finer-granularity actions that jointly achieve these goals. We ground and evaluate our framework's abilities in realistic scenarios in the VirtualHome environment and demonstrate a 31% reduction in execution time compared with a system that does not consider upcoming tasks.
title Anticipate & Act : Integrating LLMs and Classical Planning for Efficient Task Execution in Household Environments
topic Robotics
Computation and Language
Machine Learning
url https://arxiv.org/abs/2502.02066