Generative Grasp Detection and Estimation with Concept Learning-based Safety Criteria

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Farhad, Al-Harith, Abuibaid, Khalil, Plociennik, Christiane, Wagner, Achim, Ruskowski, Martin
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915354735804416
author Farhad, Al-Harith
Abuibaid, Khalil
Plociennik, Christiane
Wagner, Achim
Ruskowski, Martin
author_facet Farhad, Al-Harith
Abuibaid, Khalil
Plociennik, Christiane
Wagner, Achim
Ruskowski, Martin
contents Neural networks are often regarded as universal equations that can estimate any function. This flexibility, however, comes with the drawback of high complexity, rendering these networks into black box models, which is especially relevant in safety-centric applications. To that end, we propose a pipeline for a collaborative robot (Cobot) grasping algorithm that detects relevant tools and generates the optimal grasp. To increase the transparency and reliability of this approach, we integrate an explainable AI method that provides an explanation for the underlying prediction of a model by extracting the learned features and correlating them to corresponding classes from the input. These concepts are then used as additional criteria to ensure the safe handling of work tools. In this paper, we show the consistency of this approach and the criterion for improving the handover position. This approach was tested in an industrial environment, where a camera system was set up to enable a robot to pick up certain tools and objects.
format Preprint
id arxiv_https___arxiv_org_abs_2506_17842
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Generative Grasp Detection and Estimation with Concept Learning-based Safety Criteria
Farhad, Al-Harith
Abuibaid, Khalil
Plociennik, Christiane
Wagner, Achim
Ruskowski, Martin
Robotics
Artificial Intelligence
Neural networks are often regarded as universal equations that can estimate any function. This flexibility, however, comes with the drawback of high complexity, rendering these networks into black box models, which is especially relevant in safety-centric applications. To that end, we propose a pipeline for a collaborative robot (Cobot) grasping algorithm that detects relevant tools and generates the optimal grasp. To increase the transparency and reliability of this approach, we integrate an explainable AI method that provides an explanation for the underlying prediction of a model by extracting the learned features and correlating them to corresponding classes from the input. These concepts are then used as additional criteria to ensure the safe handling of work tools. In this paper, we show the consistency of this approach and the criterion for improving the handover position. This approach was tested in an industrial environment, where a camera system was set up to enable a robot to pick up certain tools and objects.
title Generative Grasp Detection and Estimation with Concept Learning-based Safety Criteria
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2506.17842