Anticipate & Collab: Data-driven Task Anticipation and Knowledge-driven Planning for Human-robot Collaboration

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Singh, Shivam, Swaminathan, Karthik, Arora, Raghav, Singh, Ramandeep, Datta, Ahana, Das, Dipanjan, Banerjee, Snehasis, Sridharan, Mohan, Krishna, Madhava
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909161016524800
author Singh, Shivam
Swaminathan, Karthik
Arora, Raghav
Singh, Ramandeep
Datta, Ahana
Das, Dipanjan
Banerjee, Snehasis
Sridharan, Mohan
Krishna, Madhava
author_facet Singh, Shivam
Swaminathan, Karthik
Arora, Raghav
Singh, Ramandeep
Datta, Ahana
Das, Dipanjan
Banerjee, Snehasis
Sridharan, Mohan
Krishna, Madhava
contents An agent assisting humans in daily living activities can collaborate more effectively by anticipating upcoming tasks. Data-driven methods represent the state of the art in task anticipation, planning, and related problems, but these methods are resource-hungry and opaque. Our prior work introduced a proof of concept framework that used an LLM to anticipate 3 high-level tasks that served as goals for a classical planning system that computed a sequence of low-level actions for the agent to achieve these goals. This paper describes DaTAPlan, our framework that significantly extends our prior work toward human-robot collaboration. Specifically, DaTAPlan planner computes actions for an agent and a human to collaboratively and jointly achieve the tasks anticipated by the LLM, and the agent automatically adapts to unexpected changes in human action outcomes and preferences. We evaluate DaTAPlan capabilities in a realistic simulation environment, demonstrating accurate task anticipation, effective human-robot collaboration, and the ability to adapt to unexpected changes. Project website: https://dataplan-hrc.github.io
format Preprint
id arxiv_https___arxiv_org_abs_2404_03587
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Anticipate & Collab: Data-driven Task Anticipation and Knowledge-driven Planning for Human-robot Collaboration
Singh, Shivam
Swaminathan, Karthik
Arora, Raghav
Singh, Ramandeep
Datta, Ahana
Das, Dipanjan
Banerjee, Snehasis
Sridharan, Mohan
Krishna, Madhava
Robotics
Artificial Intelligence
An agent assisting humans in daily living activities can collaborate more effectively by anticipating upcoming tasks. Data-driven methods represent the state of the art in task anticipation, planning, and related problems, but these methods are resource-hungry and opaque. Our prior work introduced a proof of concept framework that used an LLM to anticipate 3 high-level tasks that served as goals for a classical planning system that computed a sequence of low-level actions for the agent to achieve these goals. This paper describes DaTAPlan, our framework that significantly extends our prior work toward human-robot collaboration. Specifically, DaTAPlan planner computes actions for an agent and a human to collaboratively and jointly achieve the tasks anticipated by the LLM, and the agent automatically adapts to unexpected changes in human action outcomes and preferences. We evaluate DaTAPlan capabilities in a realistic simulation environment, demonstrating accurate task anticipation, effective human-robot collaboration, and the ability to adapt to unexpected changes. Project website: https://dataplan-hrc.github.io
title Anticipate & Collab: Data-driven Task Anticipation and Knowledge-driven Planning for Human-robot Collaboration
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2404.03587