How Much Progress Did I Make? An Unexplored Human Feedback Signal for Teaching Robots

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yu, Hang, Fang, Qidi, Fang, Shijie, Aronson, Reuben M., Short, Elaine Schaertl
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918264699879424
author Yu, Hang
Fang, Qidi
Fang, Shijie
Aronson, Reuben M.
Short, Elaine Schaertl
author_facet Yu, Hang
Fang, Qidi
Fang, Shijie
Aronson, Reuben M.
Short, Elaine Schaertl
contents Enhancing the expressiveness of human teaching is vital for both improving robots' learning from humans and the human-teaching-robot experience. In this work, we characterize and test a little-used teaching signal: \textit{progress}, designed to represent the completion percentage of a task. We conducted two online studies with 76 crowd-sourced participants and one public space study with 40 non-expert participants to validate the capability of this progress signal. We find that progress indicates whether the task is successfully performed, reflects the degree of task completion, identifies unproductive but harmless behaviors, and is likely to be more consistent across participants. Furthermore, our results show that giving progress does not require extra workload and time. An additional contribution of our work is a dataset of 40 non-expert demonstrations from the public space study through an ice cream topping-adding task, which we observe to be multi-policy and sub-optimal, with sub-optimality not only from teleoperation errors but also from exploratory actions and attempts. The dataset is available at https://github.com/TeachingwithProgress/Non-Expert\_Demonstrations.
format Preprint
id arxiv_https___arxiv_org_abs_2407_06459
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle How Much Progress Did I Make? An Unexplored Human Feedback Signal for Teaching Robots
Yu, Hang
Fang, Qidi
Fang, Shijie
Aronson, Reuben M.
Short, Elaine Schaertl
Robotics
Artificial Intelligence
Machine Learning
Enhancing the expressiveness of human teaching is vital for both improving robots' learning from humans and the human-teaching-robot experience. In this work, we characterize and test a little-used teaching signal: \textit{progress}, designed to represent the completion percentage of a task. We conducted two online studies with 76 crowd-sourced participants and one public space study with 40 non-expert participants to validate the capability of this progress signal. We find that progress indicates whether the task is successfully performed, reflects the degree of task completion, identifies unproductive but harmless behaviors, and is likely to be more consistent across participants. Furthermore, our results show that giving progress does not require extra workload and time. An additional contribution of our work is a dataset of 40 non-expert demonstrations from the public space study through an ice cream topping-adding task, which we observe to be multi-policy and sub-optimal, with sub-optimality not only from teleoperation errors but also from exploratory actions and attempts. The dataset is available at https://github.com/TeachingwithProgress/Non-Expert\_Demonstrations.
title How Much Progress Did I Make? An Unexplored Human Feedback Signal for Teaching Robots
topic Robotics
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2407.06459