State- and context-dependent robotic manipulation and grasping via uncertainty-aware imitation learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Winter, Tim R., Sundaram, Ashok M., Friedl, Werner, Roa, Maximo A., Stulp, Freek, Silvério, João
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916463420375040
author Winter, Tim R.
Sundaram, Ashok M.
Friedl, Werner
Roa, Maximo A.
Stulp, Freek
Silvério, João
author_facet Winter, Tim R.
Sundaram, Ashok M.
Friedl, Werner
Roa, Maximo A.
Stulp, Freek
Silvério, João
contents Generating context-adaptive manipulation and grasping actions is a challenging problem in robotics. Classical planning and control algorithms tend to be inflexible with regard to parameterization by external variables such as object shapes. In contrast, Learning from Demonstration (LfD) approaches, due to their nature as function approximators, allow for introducing external variables to modulate policies in response to the environment. In this paper, we utilize this property by introducing an LfD approach to acquire context-dependent grasping and manipulation strategies. We treat the problem as a kernel-based function approximation, where the kernel inputs include generic context variables describing task-dependent parameters such as the object shape. We build on existing work on policy fusion with uncertainty quantification to propose a state-dependent approach that automatically returns to demonstrations, avoiding unpredictable behavior while smoothly adapting to context changes. The approach is evaluated against the LASA handwriting dataset and on a real 7-DoF robot in two scenarios: adaptation to slippage while grasping and manipulating a deformable food item.
format Preprint
id arxiv_https___arxiv_org_abs_2410_24035
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle State- and context-dependent robotic manipulation and grasping via uncertainty-aware imitation learning
Winter, Tim R.
Sundaram, Ashok M.
Friedl, Werner
Roa, Maximo A.
Stulp, Freek
Silvério, João
Robotics
Artificial Intelligence
Machine Learning
Generating context-adaptive manipulation and grasping actions is a challenging problem in robotics. Classical planning and control algorithms tend to be inflexible with regard to parameterization by external variables such as object shapes. In contrast, Learning from Demonstration (LfD) approaches, due to their nature as function approximators, allow for introducing external variables to modulate policies in response to the environment. In this paper, we utilize this property by introducing an LfD approach to acquire context-dependent grasping and manipulation strategies. We treat the problem as a kernel-based function approximation, where the kernel inputs include generic context variables describing task-dependent parameters such as the object shape. We build on existing work on policy fusion with uncertainty quantification to propose a state-dependent approach that automatically returns to demonstrations, avoiding unpredictable behavior while smoothly adapting to context changes. The approach is evaluated against the LASA handwriting dataset and on a real 7-DoF robot in two scenarios: adaptation to slippage while grasping and manipulating a deformable food item.
title State- and context-dependent robotic manipulation and grasping via uncertainty-aware imitation learning
topic Robotics
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2410.24035