Saved in:
Bibliographic Details
Main Authors: Dengler, Nils, Ferrandis, Juan Del Aguila, Moura, João, Vijayakumar, Sethu, Bennewitz, Maren
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2403.17667
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913968761602048
author Dengler, Nils
Ferrandis, Juan Del Aguila
Moura, João
Vijayakumar, Sethu
Bennewitz, Maren
author_facet Dengler, Nils
Ferrandis, Juan Del Aguila
Moura, João
Vijayakumar, Sethu
Bennewitz, Maren
contents In complex scenarios where typical pick-and-place techniques are insufficient, often non-prehensile manipulation can ensure that a robot is able to fulfill its task. However, non-prehensile manipulation is challenging due to its underactuated nature with hybrid-dynamics, where a robot needs to reason about an object's long-term behavior and contact-switching, while being robust to contact uncertainty. The presence of clutter in the workspace further complicates this task, introducing the need to include more advanced spatial analysis to avoid unwanted collisions. Building upon prior work on reinforcement learning with multimodal categorical exploration for planar pushing, we propose to incorporate location-based attention to enable robust manipulation in cluttered scenes. Unlike previous approaches addressing this obstacle avoiding pushing task, our framework requires no predefined global paths and considers the desired target orientation of the manipulated object. Experimental results in simulation as well as with a real KUKA iiwa robot arm demonstrate that our learned policy manipulates objects successfully while avoiding collisions through complex obstacle configurations, including dynamic obstacles, to reach the desired target pose.
format Preprint
id arxiv_https___arxiv_org_abs_2403_17667
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Learning Goal-Directed Object Pushing in Cluttered Scenes With Location-Based Attention
Dengler, Nils
Ferrandis, Juan Del Aguila
Moura, João
Vijayakumar, Sethu
Bennewitz, Maren
Robotics
In complex scenarios where typical pick-and-place techniques are insufficient, often non-prehensile manipulation can ensure that a robot is able to fulfill its task. However, non-prehensile manipulation is challenging due to its underactuated nature with hybrid-dynamics, where a robot needs to reason about an object's long-term behavior and contact-switching, while being robust to contact uncertainty. The presence of clutter in the workspace further complicates this task, introducing the need to include more advanced spatial analysis to avoid unwanted collisions. Building upon prior work on reinforcement learning with multimodal categorical exploration for planar pushing, we propose to incorporate location-based attention to enable robust manipulation in cluttered scenes. Unlike previous approaches addressing this obstacle avoiding pushing task, our framework requires no predefined global paths and considers the desired target orientation of the manipulated object. Experimental results in simulation as well as with a real KUKA iiwa robot arm demonstrate that our learned policy manipulates objects successfully while avoiding collisions through complex obstacle configurations, including dynamic obstacles, to reach the desired target pose.
title Learning Goal-Directed Object Pushing in Cluttered Scenes With Location-Based Attention
topic Robotics
url https://arxiv.org/abs/2403.17667