Boundless: Generating Photorealistic Synthetic Data for Object Detection in Urban Streetscapes

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Turkcan, Mehmet Kerem, Li, Yuyang, Zang, Chengbo, Ghaderi, Javad, Zussman, Gil, Kostic, Zoran
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917787965849600
author Turkcan, Mehmet Kerem
Li, Yuyang
Zang, Chengbo
Ghaderi, Javad
Zussman, Gil
Kostic, Zoran
author_facet Turkcan, Mehmet Kerem
Li, Yuyang
Zang, Chengbo
Ghaderi, Javad
Zussman, Gil
Kostic, Zoran
contents We introduce Boundless, a photo-realistic synthetic data generation system for enabling highly accurate object detection in dense urban streetscapes. Boundless can replace massive real-world data collection and manual ground-truth object annotation (labeling) with an automated and configurable process. Boundless is based on the Unreal Engine 5 (UE5) City Sample project with improvements enabling accurate collection of 3D bounding boxes across different lighting and scene variability conditions. We evaluate the performance of object detection models trained on the dataset generated by Boundless when used for inference on a real-world dataset acquired from medium-altitude cameras. We compare the performance of the Boundless-trained model against the CARLA-trained model and observe an improvement of 7.8 mAP. The results we achieved support the premise that synthetic data generation is a credible methodology for training/fine-tuning scalable object detection models for urban scenes.
format Preprint
id arxiv_https___arxiv_org_abs_2409_03022
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Boundless: Generating Photorealistic Synthetic Data for Object Detection in Urban Streetscapes
Turkcan, Mehmet Kerem
Li, Yuyang
Zang, Chengbo
Ghaderi, Javad
Zussman, Gil
Kostic, Zoran
Computer Vision and Pattern Recognition
We introduce Boundless, a photo-realistic synthetic data generation system for enabling highly accurate object detection in dense urban streetscapes. Boundless can replace massive real-world data collection and manual ground-truth object annotation (labeling) with an automated and configurable process. Boundless is based on the Unreal Engine 5 (UE5) City Sample project with improvements enabling accurate collection of 3D bounding boxes across different lighting and scene variability conditions. We evaluate the performance of object detection models trained on the dataset generated by Boundless when used for inference on a real-world dataset acquired from medium-altitude cameras. We compare the performance of the Boundless-trained model against the CARLA-trained model and observe an improvement of 7.8 mAP. The results we achieved support the premise that synthetic data generation is a credible methodology for training/fine-tuning scalable object detection models for urban scenes.
title Boundless: Generating Photorealistic Synthetic Data for Object Detection in Urban Streetscapes
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2409.03022