Good Grasps Only: A data engine for self-supervised fine-tuning of pose estimation using grasp poses for verification

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
1. Verfasser: Hagelskjær, Frederik
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909425065787392
author Hagelskjær, Frederik
author_facet Hagelskjær, Frederik
contents In this paper, we present a novel method for self-supervised fine-tuning of pose estimation. Leveraging zero-shot pose estimation, our approach enables the robot to automatically obtain training data without manual labeling. After pose estimation the object is grasped, and in-hand pose estimation is used for data validation. Our pipeline allows the system to fine-tune while the process is running, removing the need for a learning phase. The motivation behind our work lies in the need for rapid setup of pose estimation solutions. Specifically, we address the challenging task of bin picking, which plays a pivotal role in flexible robotic setups. Our method is implemented on a robotics work-cell, and tested with four different objects. For all objects, our method increases the performance and outperforms a state-of-the-art method trained on the CAD model of the objects. Project page available at gogoengine.github.io
format Preprint
id arxiv_https___arxiv_org_abs_2409_11512
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Good Grasps Only: A data engine for self-supervised fine-tuning of pose estimation using grasp poses for verification
Hagelskjær, Frederik
Robotics
Computer Vision and Pattern Recognition
In this paper, we present a novel method for self-supervised fine-tuning of pose estimation. Leveraging zero-shot pose estimation, our approach enables the robot to automatically obtain training data without manual labeling. After pose estimation the object is grasped, and in-hand pose estimation is used for data validation. Our pipeline allows the system to fine-tune while the process is running, removing the need for a learning phase. The motivation behind our work lies in the need for rapid setup of pose estimation solutions. Specifically, we address the challenging task of bin picking, which plays a pivotal role in flexible robotic setups. Our method is implemented on a robotics work-cell, and tested with four different objects. For all objects, our method increases the performance and outperforms a state-of-the-art method trained on the CAD model of the objects. Project page available at gogoengine.github.io
title Good Grasps Only: A data engine for self-supervised fine-tuning of pose estimation using grasp poses for verification
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2409.11512