Unraveling the Effects of Synthetic Data on End-to-End Autonomous Driving

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ge, Junhao, Liu, Zuhong, Fan, Longteng, Jiang, Yifan, Su, Jiaqi, Li, Yiming, Zhang, Zhejun, Chen, Siheng
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915211337793536
author Ge, Junhao
Liu, Zuhong
Fan, Longteng
Jiang, Yifan
Su, Jiaqi
Li, Yiming
Zhang, Zhejun
Chen, Siheng
author_facet Ge, Junhao
Liu, Zuhong
Fan, Longteng
Jiang, Yifan
Su, Jiaqi
Li, Yiming
Zhang, Zhejun
Chen, Siheng
contents End-to-end (E2E) autonomous driving (AD) models require diverse, high-quality data to perform well across various driving scenarios. However, collecting large-scale real-world data is expensive and time-consuming, making high-fidelity synthetic data essential for enhancing data diversity and model robustness. Existing driving simulators for synthetic data generation have significant limitations: game-engine-based simulators struggle to produce realistic sensor data, while NeRF-based and diffusion-based methods face efficiency challenges. Additionally, recent simulators designed for closed-loop evaluation provide limited interaction with other vehicles, failing to simulate complex real-world traffic dynamics. To address these issues, we introduce SceneCrafter, a realistic, interactive, and efficient AD simulator based on 3D Gaussian Splatting (3DGS). SceneCrafter not only efficiently generates realistic driving logs across diverse traffic scenarios but also enables robust closed-loop evaluation of end-to-end models. Experimental results demonstrate that SceneCrafter serves as both a reliable evaluation platform and a efficient data generator that significantly improves end-to-end model generalization.
format Preprint
id arxiv_https___arxiv_org_abs_2503_18108
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Unraveling the Effects of Synthetic Data on End-to-End Autonomous Driving
Ge, Junhao
Liu, Zuhong
Fan, Longteng
Jiang, Yifan
Su, Jiaqi
Li, Yiming
Zhang, Zhejun
Chen, Siheng
Robotics
Computer Vision and Pattern Recognition
End-to-end (E2E) autonomous driving (AD) models require diverse, high-quality data to perform well across various driving scenarios. However, collecting large-scale real-world data is expensive and time-consuming, making high-fidelity synthetic data essential for enhancing data diversity and model robustness. Existing driving simulators for synthetic data generation have significant limitations: game-engine-based simulators struggle to produce realistic sensor data, while NeRF-based and diffusion-based methods face efficiency challenges. Additionally, recent simulators designed for closed-loop evaluation provide limited interaction with other vehicles, failing to simulate complex real-world traffic dynamics. To address these issues, we introduce SceneCrafter, a realistic, interactive, and efficient AD simulator based on 3D Gaussian Splatting (3DGS). SceneCrafter not only efficiently generates realistic driving logs across diverse traffic scenarios but also enables robust closed-loop evaluation of end-to-end models. Experimental results demonstrate that SceneCrafter serves as both a reliable evaluation platform and a efficient data generator that significantly improves end-to-end model generalization.
title Unraveling the Effects of Synthetic Data on End-to-End Autonomous Driving
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.18108