Saved in:
Bibliographic Details
Main Authors: Winkelbauer, Dominik, Triebel, Rudolph, Bäuml, Berthold
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2409.12339
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913506976071680
author Winkelbauer, Dominik
Triebel, Rudolph
Bäuml, Berthold
author_facet Winkelbauer, Dominik
Triebel, Rudolph
Bäuml, Berthold
contents Existing grasp controllers usually either only support finger-tip grasps or need explicit configuration of the inner forces. We propose a novel grasp controller that supports arbitrary grasp types, including power grasps with multi-contacts, while operating self-contained on before unseen objects. No detailed contact information is needed, but only a rough 3D model, e.g., reconstructed from a single depth image. First, the external wrench being applied to the object is estimated by using the measured torques at the joints. Then, the torques necessary to counteract the estimated wrench while keeping the object at its initial pose are predicted. The torques are commanded via desired joint angles to an underlying joint-level impedance controller. To reach real-time performance, we propose a learning-based approach that is based on a wrench estimator- and a torque predictor neural network. Both networks are trained in a supervised fashion using data generated via the analytical formulation of the controller. In an extensive simulation-based evaluation, we show that our controller is able to keep 83.1% of the tested grasps stable when applying external wrenches with up to 10N. At the same time, we outperform the two tested baselines by being more efficient and inducing less involuntary object movement. Finally, we show that the controller also works on the real DLR-Hand II, reaching a cycle time of 6ms.
format Preprint
id arxiv_https___arxiv_org_abs_2409_12339
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Learning-based Controller for Multi-Contact Grasps on Unknown Objects with a Dexterous Hand
Winkelbauer, Dominik
Triebel, Rudolph
Bäuml, Berthold
Robotics
Existing grasp controllers usually either only support finger-tip grasps or need explicit configuration of the inner forces. We propose a novel grasp controller that supports arbitrary grasp types, including power grasps with multi-contacts, while operating self-contained on before unseen objects. No detailed contact information is needed, but only a rough 3D model, e.g., reconstructed from a single depth image. First, the external wrench being applied to the object is estimated by using the measured torques at the joints. Then, the torques necessary to counteract the estimated wrench while keeping the object at its initial pose are predicted. The torques are commanded via desired joint angles to an underlying joint-level impedance controller. To reach real-time performance, we propose a learning-based approach that is based on a wrench estimator- and a torque predictor neural network. Both networks are trained in a supervised fashion using data generated via the analytical formulation of the controller. In an extensive simulation-based evaluation, we show that our controller is able to keep 83.1% of the tested grasps stable when applying external wrenches with up to 10N. At the same time, we outperform the two tested baselines by being more efficient and inducing less involuntary object movement. Finally, we show that the controller also works on the real DLR-Hand II, reaching a cycle time of 6ms.
title A Learning-based Controller for Multi-Contact Grasps on Unknown Objects with a Dexterous Hand
topic Robotics
url https://arxiv.org/abs/2409.12339