Integrating Disambiguation and User Preferences into Large Language Models for Robot Motion Planning

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Abugurain, Mohammed, Park, Shinkyu
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911849796075520
author Abugurain, Mohammed
Park, Shinkyu
author_facet Abugurain, Mohammed
Park, Shinkyu
contents This paper presents a framework that can interpret humans' navigation commands containing temporal elements and directly translate their natural language instructions into robot motion planning. Central to our framework is utilizing Large Language Models (LLMs). To enhance the reliability of LLMs in the framework and improve user experience, we propose methods to resolve the ambiguity in natural language instructions and capture user preferences. The process begins with an ambiguity classifier, identifying potential uncertainties in the instructions. Ambiguous statements trigger a GPT-4-based mechanism that generates clarifying questions, incorporating user responses for disambiguation. Also, the framework assesses and records user preferences for non-ambiguous instructions, enhancing future interactions. The last part of this process is the translation of disambiguated instructions into a robot motion plan using Linear Temporal Logic. This paper details the development of this framework and the evaluation of its performance in various test scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2404_14547
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Integrating Disambiguation and User Preferences into Large Language Models for Robot Motion Planning
Abugurain, Mohammed
Park, Shinkyu
Robotics
Artificial Intelligence
Systems and Control
This paper presents a framework that can interpret humans' navigation commands containing temporal elements and directly translate their natural language instructions into robot motion planning. Central to our framework is utilizing Large Language Models (LLMs). To enhance the reliability of LLMs in the framework and improve user experience, we propose methods to resolve the ambiguity in natural language instructions and capture user preferences. The process begins with an ambiguity classifier, identifying potential uncertainties in the instructions. Ambiguous statements trigger a GPT-4-based mechanism that generates clarifying questions, incorporating user responses for disambiguation. Also, the framework assesses and records user preferences for non-ambiguous instructions, enhancing future interactions. The last part of this process is the translation of disambiguated instructions into a robot motion plan using Linear Temporal Logic. This paper details the development of this framework and the evaluation of its performance in various test scenarios.
title Integrating Disambiguation and User Preferences into Large Language Models for Robot Motion Planning
topic Robotics
Artificial Intelligence
Systems and Control
url https://arxiv.org/abs/2404.14547