Creating and Repairing Robot Programs in Open-World Domains

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Schlesinger, Claire, Guha, Arjun, Biswas, Joydeep
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910665015296000
author Schlesinger, Claire
Guha, Arjun
Biswas, Joydeep
author_facet Schlesinger, Claire
Guha, Arjun
Biswas, Joydeep
contents Using Large Language Models (LLMs) to produce robot programs from natural language has allowed for robot systems that can complete a higher diversity of tasks. However, LLM-generated programs may be faulty, either due to ambiguity in instructions, misinterpretation of the desired task, or missing information about the world state. As these programs run, the state of the world changes and they gather new information. When a failure occurs, it is important that they recover from the current world state and avoid repeating steps that they they previously completed successfully. We propose RoboRepair, a system which traces the execution of a program up until error, and then runs an LLM-produced recovery program that minimizes repeated actions. To evaluate the efficacy of our system, we create a benchmark consisting of eleven tasks with various error conditions that require the generation of a recovery program. We compare the efficiency of the recovery program to a plan built with an oracle that has foreknowledge of future errors.
format Preprint
id arxiv_https___arxiv_org_abs_2410_18893
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Creating and Repairing Robot Programs in Open-World Domains
Schlesinger, Claire
Guha, Arjun
Biswas, Joydeep
Robotics
Artificial Intelligence
Using Large Language Models (LLMs) to produce robot programs from natural language has allowed for robot systems that can complete a higher diversity of tasks. However, LLM-generated programs may be faulty, either due to ambiguity in instructions, misinterpretation of the desired task, or missing information about the world state. As these programs run, the state of the world changes and they gather new information. When a failure occurs, it is important that they recover from the current world state and avoid repeating steps that they they previously completed successfully. We propose RoboRepair, a system which traces the execution of a program up until error, and then runs an LLM-produced recovery program that minimizes repeated actions. To evaluate the efficacy of our system, we create a benchmark consisting of eleven tasks with various error conditions that require the generation of a recovery program. We compare the efficiency of the recovery program to a plan built with an oracle that has foreknowledge of future errors.
title Creating and Repairing Robot Programs in Open-World Domains
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2410.18893