Saved in:
Bibliographic Details
Main Authors: Wan, Yuxuan, Zhou, Kaichen, Chen, jinhong, Dong, Hao
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2403.18195
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912390445006848
author Wan, Yuxuan
Zhou, Kaichen
Chen, jinhong
Dong, Hao
author_facet Wan, Yuxuan
Zhou, Kaichen
Chen, jinhong
Dong, Hao
contents Autonomous assembly in robotics and 3D vision presents significant challenges, particularly in ensuring assembly correctness. Presently, predominant methods such as MEPNet focus on assembling components based on manually provided images. However, these approaches often fall short in achieving satisfactory results for tasks requiring long-term planning. Concurrently, we observe that integrating a self-correction module can partially alleviate such issues. Motivated by this concern, we introduce the Single-Step Assembly Error Correction Task, which involves identifying and rectifying misassembled components. To support research in this area, we present the LEGO Error Correction Assembly Dataset (LEGO-ECA), comprising manual images for assembly steps and instances of assembly failures. Additionally, we propose the Self-Correct Assembly Network (SCANet), a novel method to address this task. SCANet treats assembled components as queries, determining their correctness in manual images and providing corrections when necessary. Finally, we utilize SCANet to correct the assembly results of MEPNet. Experimental results demonstrate that SCANet can identify and correct MEPNet's misassembled results, significantly improving the correctness of assembly. Our code and dataset could be found at https://scanet-iros2024.github.io/.
format Preprint
id arxiv_https___arxiv_org_abs_2403_18195
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle SCANet: Correcting LEGO Assembly Errors with Self-Correct Assembly Network
Wan, Yuxuan
Zhou, Kaichen
Chen, jinhong
Dong, Hao
Robotics
Artificial Intelligence
Autonomous assembly in robotics and 3D vision presents significant challenges, particularly in ensuring assembly correctness. Presently, predominant methods such as MEPNet focus on assembling components based on manually provided images. However, these approaches often fall short in achieving satisfactory results for tasks requiring long-term planning. Concurrently, we observe that integrating a self-correction module can partially alleviate such issues. Motivated by this concern, we introduce the Single-Step Assembly Error Correction Task, which involves identifying and rectifying misassembled components. To support research in this area, we present the LEGO Error Correction Assembly Dataset (LEGO-ECA), comprising manual images for assembly steps and instances of assembly failures. Additionally, we propose the Self-Correct Assembly Network (SCANet), a novel method to address this task. SCANet treats assembled components as queries, determining their correctness in manual images and providing corrections when necessary. Finally, we utilize SCANet to correct the assembly results of MEPNet. Experimental results demonstrate that SCANet can identify and correct MEPNet's misassembled results, significantly improving the correctness of assembly. Our code and dataset could be found at https://scanet-iros2024.github.io/.
title SCANet: Correcting LEGO Assembly Errors with Self-Correct Assembly Network
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2403.18195