Recover: A Neuro-Symbolic Framework for Failure Detection and Recovery

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Cornelio, Cristina, Diab, Mohammed
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914736394731520
author Cornelio, Cristina
Diab, Mohammed
author_facet Cornelio, Cristina
Diab, Mohammed
contents Recognizing failures during task execution and implementing recovery procedures is challenging in robotics. Traditional approaches rely on the availability of extensive data or a tight set of constraints, while more recent approaches leverage large language models (LLMs) to verify task steps and replan accordingly. However, these methods often operate offline, necessitating scene resets and incurring in high costs. This paper introduces Recover, a neuro-symbolic framework for online failure identification and recovery. By integrating ontologies, logical rules, and LLM-based planners, Recover exploits symbolic information to enhance the ability of LLMs to generate recovery plans and also to decrease the associated costs. In order to demonstrate the capabilities of our method in a simulated kitchen environment, we introduce OntoThor, an ontology describing the AI2Thor simulator setting. Empirical evaluation shows that OntoThor's logical rules accurately detect all failures in the analyzed tasks, and that Recover considerably outperforms, for both failure detection and recovery, a baseline method reliant solely on LLMs.
format Preprint
id arxiv_https___arxiv_org_abs_2404_00756
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Recover: A Neuro-Symbolic Framework for Failure Detection and Recovery
Cornelio, Cristina
Diab, Mohammed
Artificial Intelligence
Machine Learning
Logic in Computer Science
Robotics
Recognizing failures during task execution and implementing recovery procedures is challenging in robotics. Traditional approaches rely on the availability of extensive data or a tight set of constraints, while more recent approaches leverage large language models (LLMs) to verify task steps and replan accordingly. However, these methods often operate offline, necessitating scene resets and incurring in high costs. This paper introduces Recover, a neuro-symbolic framework for online failure identification and recovery. By integrating ontologies, logical rules, and LLM-based planners, Recover exploits symbolic information to enhance the ability of LLMs to generate recovery plans and also to decrease the associated costs. In order to demonstrate the capabilities of our method in a simulated kitchen environment, we introduce OntoThor, an ontology describing the AI2Thor simulator setting. Empirical evaluation shows that OntoThor's logical rules accurately detect all failures in the analyzed tasks, and that Recover considerably outperforms, for both failure detection and recovery, a baseline method reliant solely on LLMs.
title Recover: A Neuro-Symbolic Framework for Failure Detection and Recovery
topic Artificial Intelligence
Machine Learning
Logic in Computer Science
Robotics
url https://arxiv.org/abs/2404.00756