Saved in:
Bibliographic Details
Main Authors: Lehman, Dan, Schoonbeek, Tim J., Hung, Shao-Hsuan, Kustra, Jacek, de With, Peter H. N., van der Sommen, Fons
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2408.12945
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910574857682944
author Lehman, Dan
Schoonbeek, Tim J.
Hung, Shao-Hsuan
Kustra, Jacek
de With, Peter H. N.
van der Sommen, Fons
author_facet Lehman, Dan
Schoonbeek, Tim J.
Hung, Shao-Hsuan
Kustra, Jacek
de With, Peter H. N.
van der Sommen, Fons
contents Recognizing errors in assembly and maintenance procedures is valuable for industrial applications, since it can increase worker efficiency and prevent unplanned down-time. Although assembly state recognition is gaining attention, none of the current works investigate assembly error localization. Therefore, we propose StateDiffNet, which localizes assembly errors based on detecting the differences between a (correct) intended assembly state and a test image from a similar viewpoint. StateDiffNet is trained on synthetically generated image pairs, providing full control over the type of meaningful change that should be detected. The proposed approach is the first to correctly localize assembly errors taken from real ego-centric video data for both states and error types that are never presented during training. Furthermore, the deployment of change detection to this industrial application provides valuable insights and considerations into the mechanisms of state-of-the-art change detection algorithms. The code and data generation pipeline are publicly available at: https://timschoonbeek.github.io/error_seg.
format Preprint
id arxiv_https___arxiv_org_abs_2408_12945
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Find the Assembly Mistakes: Error Segmentation for Industrial Applications
Lehman, Dan
Schoonbeek, Tim J.
Hung, Shao-Hsuan
Kustra, Jacek
de With, Peter H. N.
van der Sommen, Fons
Computer Vision and Pattern Recognition
Recognizing errors in assembly and maintenance procedures is valuable for industrial applications, since it can increase worker efficiency and prevent unplanned down-time. Although assembly state recognition is gaining attention, none of the current works investigate assembly error localization. Therefore, we propose StateDiffNet, which localizes assembly errors based on detecting the differences between a (correct) intended assembly state and a test image from a similar viewpoint. StateDiffNet is trained on synthetically generated image pairs, providing full control over the type of meaningful change that should be detected. The proposed approach is the first to correctly localize assembly errors taken from real ego-centric video data for both states and error types that are never presented during training. Furthermore, the deployment of change detection to this industrial application provides valuable insights and considerations into the mechanisms of state-of-the-art change detection algorithms. The code and data generation pipeline are publicly available at: https://timschoonbeek.github.io/error_seg.
title Find the Assembly Mistakes: Error Segmentation for Industrial Applications
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2408.12945