Saved in:
Bibliographic Details
Main Authors: Tabernik, Domen, Muhovič, Jon, Urbas, Matej, Skočaj, Danijel
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2408.14456
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909312616497152
author Tabernik, Domen
Muhovič, Jon
Urbas, Matej
Skočaj, Danijel
author_facet Tabernik, Domen
Muhovič, Jon
Urbas, Matej
Skočaj, Danijel
contents Object grasping is a fundamental challenge in robotics and computer vision, critical for advancing robotic manipulation capabilities. Deformable objects, like fabrics and cloths, pose additional challenges due to their non-rigid nature. In this work, we introduce CeDiRNet-3DoF, a deep-learning model for grasp point detection, with a particular focus on cloth objects. CeDiRNet-3DoF employs center direction regression alongside a localization network, attaining first place in the perception task of ICRA 2023's Cloth Manipulation Challenge. Recognizing the lack of standardized benchmarks in the literature that hinder effective method comparison, we present the ViCoS Towel Dataset. This extensive benchmark dataset comprises 8,000 real and 12,000 synthetic images, serving as a robust resource for training and evaluating contemporary data-driven deep-learning approaches. Extensive evaluation revealed CeDiRNet-3DoF's robustness in real-world performance, outperforming state-of-the-art methods, including the latest transformer-based models. Our work bridges a crucial gap, offering a robust solution and benchmark for cloth grasping in computer vision and robotics. Code and dataset are available at: https://github.com/vicoslab/CeDiRNet-3DoF
format Preprint
id arxiv_https___arxiv_org_abs_2408_14456
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Center Direction Network for Grasping Point Localization on Cloths
Tabernik, Domen
Muhovič, Jon
Urbas, Matej
Skočaj, Danijel
Computer Vision and Pattern Recognition
Object grasping is a fundamental challenge in robotics and computer vision, critical for advancing robotic manipulation capabilities. Deformable objects, like fabrics and cloths, pose additional challenges due to their non-rigid nature. In this work, we introduce CeDiRNet-3DoF, a deep-learning model for grasp point detection, with a particular focus on cloth objects. CeDiRNet-3DoF employs center direction regression alongside a localization network, attaining first place in the perception task of ICRA 2023's Cloth Manipulation Challenge. Recognizing the lack of standardized benchmarks in the literature that hinder effective method comparison, we present the ViCoS Towel Dataset. This extensive benchmark dataset comprises 8,000 real and 12,000 synthetic images, serving as a robust resource for training and evaluating contemporary data-driven deep-learning approaches. Extensive evaluation revealed CeDiRNet-3DoF's robustness in real-world performance, outperforming state-of-the-art methods, including the latest transformer-based models. Our work bridges a crucial gap, offering a robust solution and benchmark for cloth grasping in computer vision and robotics. Code and dataset are available at: https://github.com/vicoslab/CeDiRNet-3DoF
title Center Direction Network for Grasping Point Localization on Cloths
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2408.14456