LLM-as-BT-Planner: Leveraging LLMs for Behavior Tree Generation in Robot Task Planning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ao, Jicong, Wu, Fan, Wu, Yansong, Swikir, Abdalla, Haddadin, Sami
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916798248517632
author Ao, Jicong
Wu, Fan
Wu, Yansong
Swikir, Abdalla
Haddadin, Sami
author_facet Ao, Jicong
Wu, Fan
Wu, Yansong
Swikir, Abdalla
Haddadin, Sami
contents Robotic assembly tasks remain an open challenge due to their long horizon nature and complex part relations. Behavior trees (BTs) are increasingly used in robot task planning for their modularity and flexibility, but creating them manually can be effort-intensive. Large language models (LLMs) have recently been applied to robotic task planning for generating action sequences, yet their ability to generate BTs has not been fully investigated. To this end, we propose LLM-as-BT-Planner, a novel framework that leverages LLMs for BT generation in robotic assembly task planning. Four in-context learning methods are introduced to utilize the natural language processing and inference capabilities of LLMs for producing task plans in BT format, reducing manual effort while ensuring robustness and comprehensibility. Additionally, we evaluate the performance of fine-tuned smaller LLMs on the same tasks. Experiments in both simulated and real-world settings demonstrate that our framework enhances LLMs' ability to generate BTs, improving success rate through in-context learning and supervised fine-tuning.
format Preprint
id arxiv_https___arxiv_org_abs_2409_10444
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle LLM-as-BT-Planner: Leveraging LLMs for Behavior Tree Generation in Robot Task Planning
Ao, Jicong
Wu, Fan
Wu, Yansong
Swikir, Abdalla
Haddadin, Sami
Robotics
Robotic assembly tasks remain an open challenge due to their long horizon nature and complex part relations. Behavior trees (BTs) are increasingly used in robot task planning for their modularity and flexibility, but creating them manually can be effort-intensive. Large language models (LLMs) have recently been applied to robotic task planning for generating action sequences, yet their ability to generate BTs has not been fully investigated. To this end, we propose LLM-as-BT-Planner, a novel framework that leverages LLMs for BT generation in robotic assembly task planning. Four in-context learning methods are introduced to utilize the natural language processing and inference capabilities of LLMs for producing task plans in BT format, reducing manual effort while ensuring robustness and comprehensibility. Additionally, we evaluate the performance of fine-tuned smaller LLMs on the same tasks. Experiments in both simulated and real-world settings demonstrate that our framework enhances LLMs' ability to generate BTs, improving success rate through in-context learning and supervised fine-tuning.
title LLM-as-BT-Planner: Leveraging LLMs for Behavior Tree Generation in Robot Task Planning
topic Robotics
url https://arxiv.org/abs/2409.10444