Demonstration Based Explainable AI for Learning from Demonstration Methods

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gu, Morris, Croft, Elizabeth, Kulic, Dana
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914968962596864
author Gu, Morris
Croft, Elizabeth
Kulic, Dana
author_facet Gu, Morris
Croft, Elizabeth
Kulic, Dana
contents Learning from Demonstration (LfD) is a powerful type of machine learning that can allow novices to teach and program robots to complete various tasks. However, the learning process for these systems may still be difficult for novices to interpret and understand, making effective teaching challenging. Explainable artificial intelligence (XAI) aims to address this challenge by explaining a system to the user. In this work, we investigate XAI within LfD by implementing an adaptive explanatory feedback system on an inverse reinforcement learning (IRL) algorithm. The feedback is implemented by demonstrating selected learnt trajectories to users. The system adapts to user teaching by categorizing and then selectively sampling trajectories shown to a user, to show a representative sample of both successful and unsuccessful trajectories. The system was evaluated through a user study with 26 participants teaching a robot a navigation task. The results of the user study demonstrated that the proposed explanatory feedback system can improve robot performance, teaching efficiency and user understanding of the robot.
format Preprint
id arxiv_https___arxiv_org_abs_2410_05715
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Demonstration Based Explainable AI for Learning from Demonstration Methods
Gu, Morris
Croft, Elizabeth
Kulic, Dana
Robotics
Learning from Demonstration (LfD) is a powerful type of machine learning that can allow novices to teach and program robots to complete various tasks. However, the learning process for these systems may still be difficult for novices to interpret and understand, making effective teaching challenging. Explainable artificial intelligence (XAI) aims to address this challenge by explaining a system to the user. In this work, we investigate XAI within LfD by implementing an adaptive explanatory feedback system on an inverse reinforcement learning (IRL) algorithm. The feedback is implemented by demonstrating selected learnt trajectories to users. The system adapts to user teaching by categorizing and then selectively sampling trajectories shown to a user, to show a representative sample of both successful and unsuccessful trajectories. The system was evaluated through a user study with 26 participants teaching a robot a navigation task. The results of the user study demonstrated that the proposed explanatory feedback system can improve robot performance, teaching efficiency and user understanding of the robot.
title Demonstration Based Explainable AI for Learning from Demonstration Methods
topic Robotics
url https://arxiv.org/abs/2410.05715