Improving Pallet Detection Using Synthetic Data

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gann, Henry, Bull, Josiah, Gee, Trevor, Nejati, Mahla
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917587301957632
author Gann, Henry
Bull, Josiah
Gee, Trevor
Nejati, Mahla
author_facet Gann, Henry
Bull, Josiah
Gee, Trevor
Nejati, Mahla
contents The use of synthetic data in machine learning saves a significant amount of time when implementing an effective object detector. However, there is limited research in this domain. This study aims to improve upon previously applied implementations in the task of instance segmentation of pallets in a warehouse environment. This study proposes using synthetically generated domain-randomised data as well as data generated through Unity to achieve this. This study achieved performance improvements on the stacked and racked pallet categories by 69% and 50% mAP50, respectively when being evaluated on real data. Additionally, it was found that there was a considerable impact on the performance of a model when it was evaluated against images in a darker environment, dropping as low as 3% mAP50 when being evaluated on images with an 80% brightness reduction. This study also created a two-stage detector that used YOLOv8 and SAM, but this proved to have unstable performance. The use of domain-randomised data proved to have negligible performance improvements when compared to the Unity-generated data.
format Preprint
id arxiv_https___arxiv_org_abs_2402_07098
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Improving Pallet Detection Using Synthetic Data
Gann, Henry
Bull, Josiah
Gee, Trevor
Nejati, Mahla
Robotics
Artificial Intelligence
The use of synthetic data in machine learning saves a significant amount of time when implementing an effective object detector. However, there is limited research in this domain. This study aims to improve upon previously applied implementations in the task of instance segmentation of pallets in a warehouse environment. This study proposes using synthetically generated domain-randomised data as well as data generated through Unity to achieve this. This study achieved performance improvements on the stacked and racked pallet categories by 69% and 50% mAP50, respectively when being evaluated on real data. Additionally, it was found that there was a considerable impact on the performance of a model when it was evaluated against images in a darker environment, dropping as low as 3% mAP50 when being evaluated on images with an 80% brightness reduction. This study also created a two-stage detector that used YOLOv8 and SAM, but this proved to have unstable performance. The use of domain-randomised data proved to have negligible performance improvements when compared to the Unity-generated data.
title Improving Pallet Detection Using Synthetic Data
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2402.07098