Integrating Explanations in Learning LTL Specifications from Demonstrations

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Gupta, Ashutosh, Komp, John, Rajput, Abhay Singh, Shankaranarayanan, Krishna, Trivedi, Ashutosh, Varshney, Namrita
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917629646602240
author Gupta, Ashutosh
Komp, John
Rajput, Abhay Singh
Shankaranarayanan, Krishna
Trivedi, Ashutosh
Varshney, Namrita
author_facet Gupta, Ashutosh
Komp, John
Rajput, Abhay Singh
Shankaranarayanan, Krishna
Trivedi, Ashutosh
Varshney, Namrita
contents This paper investigates whether recent advances in Large Language Models (LLMs) can assist in translating human explanations into a format that can robustly support learning Linear Temporal Logic (LTL) from demonstrations. Both LLMs and optimization-based methods can extract LTL specifications from demonstrations; however, they have distinct limitations. LLMs can quickly generate solutions and incorporate human explanations, but their lack of consistency and reliability hampers their applicability in safety-critical domains. On the other hand, optimization-based methods do provide formal guarantees but cannot process natural language explanations and face scalability challenges. We present a principled approach to combining LLMs and optimization-based methods to faithfully translate human explanations and demonstrations into LTL specifications. We have implemented a tool called Janaka based on our approach. Our experiments demonstrate the effectiveness of combining explanations with demonstrations in learning LTL specifications through several case studies.
format Preprint
id arxiv_https___arxiv_org_abs_2404_02872
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Integrating Explanations in Learning LTL Specifications from Demonstrations
Gupta, Ashutosh
Komp, John
Rajput, Abhay Singh
Shankaranarayanan, Krishna
Trivedi, Ashutosh
Varshney, Namrita
Artificial Intelligence
I.2.8
This paper investigates whether recent advances in Large Language Models (LLMs) can assist in translating human explanations into a format that can robustly support learning Linear Temporal Logic (LTL) from demonstrations. Both LLMs and optimization-based methods can extract LTL specifications from demonstrations; however, they have distinct limitations. LLMs can quickly generate solutions and incorporate human explanations, but their lack of consistency and reliability hampers their applicability in safety-critical domains. On the other hand, optimization-based methods do provide formal guarantees but cannot process natural language explanations and face scalability challenges. We present a principled approach to combining LLMs and optimization-based methods to faithfully translate human explanations and demonstrations into LTL specifications. We have implemented a tool called Janaka based on our approach. Our experiments demonstrate the effectiveness of combining explanations with demonstrations in learning LTL specifications through several case studies.
title Integrating Explanations in Learning LTL Specifications from Demonstrations
topic Artificial Intelligence
I.2.8
url https://arxiv.org/abs/2404.02872