Domain Randomization for Object Detection in Manufacturing Applications using Synthetic Data: A Comprehensive Study

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhu, Xiaomeng, Henningsson, Jacob, Li, Duruo, Mårtensson, Pär, Hanson, Lars, Björkman, Mårten, Maki, Atsuto
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916785228349440
author Zhu, Xiaomeng
Henningsson, Jacob
Li, Duruo
Mårtensson, Pär
Hanson, Lars
Björkman, Mårten
Maki, Atsuto
author_facet Zhu, Xiaomeng
Henningsson, Jacob
Li, Duruo
Mårtensson, Pär
Hanson, Lars
Björkman, Mårten
Maki, Atsuto
contents This paper addresses key aspects of domain randomization in generating synthetic data for manufacturing object detection applications. To this end, we present a comprehensive data generation pipeline that reflects different factors: object characteristics, background, illumination, camera settings, and post-processing. We also introduce the Synthetic Industrial Parts Object Detection dataset (SIP15-OD) consisting of 15 objects from three industrial use cases under varying environments as a test bed for the study, while also employing an industrial dataset publicly available for robotic applications. In our experiments, we present more abundant results and insights into the feasibility as well as challenges of sim-to-real object detection. In particular, we identified material properties, rendering methods, post-processing, and distractors as important factors. Our method, leveraging these, achieves top performance on the public dataset with Yolov8 models trained exclusively on synthetic data; mAP@50 scores of 96.4% for the robotics dataset, and 94.1%, 99.5%, and 95.3% across three of the SIP15-OD use cases, respectively. The results showcase the effectiveness of the proposed domain randomization, potentially covering the distribution close to real data for the applications.
format Preprint
id arxiv_https___arxiv_org_abs_2506_07539
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Domain Randomization for Object Detection in Manufacturing Applications using Synthetic Data: A Comprehensive Study
Zhu, Xiaomeng
Henningsson, Jacob
Li, Duruo
Mårtensson, Pär
Hanson, Lars
Björkman, Mårten
Maki, Atsuto
Computer Vision and Pattern Recognition
Artificial Intelligence
This paper addresses key aspects of domain randomization in generating synthetic data for manufacturing object detection applications. To this end, we present a comprehensive data generation pipeline that reflects different factors: object characteristics, background, illumination, camera settings, and post-processing. We also introduce the Synthetic Industrial Parts Object Detection dataset (SIP15-OD) consisting of 15 objects from three industrial use cases under varying environments as a test bed for the study, while also employing an industrial dataset publicly available for robotic applications. In our experiments, we present more abundant results and insights into the feasibility as well as challenges of sim-to-real object detection. In particular, we identified material properties, rendering methods, post-processing, and distractors as important factors. Our method, leveraging these, achieves top performance on the public dataset with Yolov8 models trained exclusively on synthetic data; mAP@50 scores of 96.4% for the robotics dataset, and 94.1%, 99.5%, and 95.3% across three of the SIP15-OD use cases, respectively. The results showcase the effectiveness of the proposed domain randomization, potentially covering the distribution close to real data for the applications.
title Domain Randomization for Object Detection in Manufacturing Applications using Synthetic Data: A Comprehensive Study
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2506.07539