Saved in:
Bibliographic Details
Main Authors: Cuan, Catie, Okamura, Allison, Khansari, Mohi
Format: Preprint
Published: 2022
Subjects:
Online Access:https://arxiv.org/abs/2211.03020
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913291126702080
author Cuan, Catie
Okamura, Allison
Khansari, Mohi
author_facet Cuan, Catie
Okamura, Allison
Khansari, Mohi
contents Learning from demonstration is a proven technique to teach robots new skills. Data quality and quantity play a critical role in the performance of models trained using data collected from human demonstrations. In this paper we enhance an existing teleoperation data collection system with real-time haptic feedback to the human demonstrators; we observe improvements in the collected data throughput and in the performance of autonomous policies using models trained with the data. Our experimental testbed was a mobile manipulator robot that opened doors with latch handles. Evaluation of teleoperated data collection on eight real conference room doors found that adding haptic feedback improved data throughput by 6%. We additionally used the collected data to train six image-based deep imitation learning models, three with haptic feedback and three without it. These models were used to implement autonomous door-opening with the same type of robot used during data collection. A policy from a imitation learning model trained with data collected while the human demonstrators received haptic feedback performed on average 11% better than its counterpart trained with data collected without haptic feedback, indicating that haptic feedback provided during data collection resulted in improved autonomous policies.
format Preprint
id arxiv_https___arxiv_org_abs_2211_03020
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Leveraging Haptic Feedback to Improve Data Quality and Quantity for Deep Imitation Learning Models
Cuan, Catie
Okamura, Allison
Khansari, Mohi
Robotics
Learning from demonstration is a proven technique to teach robots new skills. Data quality and quantity play a critical role in the performance of models trained using data collected from human demonstrations. In this paper we enhance an existing teleoperation data collection system with real-time haptic feedback to the human demonstrators; we observe improvements in the collected data throughput and in the performance of autonomous policies using models trained with the data. Our experimental testbed was a mobile manipulator robot that opened doors with latch handles. Evaluation of teleoperated data collection on eight real conference room doors found that adding haptic feedback improved data throughput by 6%. We additionally used the collected data to train six image-based deep imitation learning models, three with haptic feedback and three without it. These models were used to implement autonomous door-opening with the same type of robot used during data collection. A policy from a imitation learning model trained with data collected while the human demonstrators received haptic feedback performed on average 11% better than its counterpart trained with data collected without haptic feedback, indicating that haptic feedback provided during data collection resulted in improved autonomous policies.
title Leveraging Haptic Feedback to Improve Data Quality and Quantity for Deep Imitation Learning Models
topic Robotics
url https://arxiv.org/abs/2211.03020