Information-driven Affordance Discovery for Efficient Robotic Manipulation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Mazzaglia, Pietro, Cohen, Taco, Dijkman, Daniel
Format: Preprint
Veröffentlicht: 2023
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911914690347008
author Mazzaglia, Pietro
Cohen, Taco
Dijkman, Daniel
author_facet Mazzaglia, Pietro
Cohen, Taco
Dijkman, Daniel
contents Robotic affordances, providing information about what actions can be taken in a given situation, can aid robotic manipulation. However, learning about affordances requires expensive large annotated datasets of interactions or demonstrations. In this work, we argue that well-directed interactions with the environment can mitigate this problem and propose an information-based measure to augment the agent's objective and accelerate the affordance discovery process. We provide a theoretical justification of our approach and we empirically validate the approach both in simulation and real-world tasks. Our method, which we dub IDA, enables the efficient discovery of visual affordances for several action primitives, such as grasping, stacking objects, or opening drawers, strongly improving data efficiency in simulation, and it allows us to learn grasping affordances in a small number of interactions, on a real-world setup with a UFACTORY XArm 6 robot arm.
format Preprint
id arxiv_https___arxiv_org_abs_2308_14915
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Information-driven Affordance Discovery for Efficient Robotic Manipulation
Mazzaglia, Pietro
Cohen, Taco
Dijkman, Daniel
Robotics
Robotic affordances, providing information about what actions can be taken in a given situation, can aid robotic manipulation. However, learning about affordances requires expensive large annotated datasets of interactions or demonstrations. In this work, we argue that well-directed interactions with the environment can mitigate this problem and propose an information-based measure to augment the agent's objective and accelerate the affordance discovery process. We provide a theoretical justification of our approach and we empirically validate the approach both in simulation and real-world tasks. Our method, which we dub IDA, enables the efficient discovery of visual affordances for several action primitives, such as grasping, stacking objects, or opening drawers, strongly improving data efficiency in simulation, and it allows us to learn grasping affordances in a small number of interactions, on a real-world setup with a UFACTORY XArm 6 robot arm.
title Information-driven Affordance Discovery for Efficient Robotic Manipulation
topic Robotics
url https://arxiv.org/abs/2308.14915