SynAD: Enhancing Real-World End-to-End Autonomous Driving Models through Synthetic Data Integration

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kim, Jongsuk, Lee, Jaeyoung, Han, Gyojin, Lee, Dongjae, Jeong, Minki, Kim, Junmo
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917047802265600
author Kim, Jongsuk
Lee, Jaeyoung
Han, Gyojin
Lee, Dongjae
Jeong, Minki
Kim, Junmo
author_facet Kim, Jongsuk
Lee, Jaeyoung
Han, Gyojin
Lee, Dongjae
Jeong, Minki
Kim, Junmo
contents Recent advancements in deep learning and the availability of high-quality real-world driving datasets have propelled end-to-end autonomous driving. Despite this progress, relying solely on real-world data limits the variety of driving scenarios for training. Synthetic scenario generation has emerged as a promising solution to enrich the diversity of training data; however, its application within E2E AD models remains largely unexplored. This is primarily due to the absence of a designated ego vehicle and the associated sensor inputs, such as camera or LiDAR, typically provided in real-world scenarios. To address this gap, we introduce SynAD, the first framework designed to enhance real-world E2E AD models using synthetic data. Our method designates the agent with the most comprehensive driving information as the ego vehicle in a multi-agent synthetic scenario. We further project path-level scenarios onto maps and employ a newly developed Map-to-BEV Network to derive bird's-eye-view features without relying on sensor inputs. Finally, we devise a training strategy that effectively integrates these map-based synthetic data with real driving data. Experimental results demonstrate that SynAD effectively integrates all components and notably enhances safety performance. By bridging synthetic scenario generation and E2E AD, SynAD paves the way for more comprehensive and robust autonomous driving models.
format Preprint
id arxiv_https___arxiv_org_abs_2510_24052
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SynAD: Enhancing Real-World End-to-End Autonomous Driving Models through Synthetic Data Integration
Kim, Jongsuk
Lee, Jaeyoung
Han, Gyojin
Lee, Dongjae
Jeong, Minki
Kim, Junmo
Robotics
Artificial Intelligence
Recent advancements in deep learning and the availability of high-quality real-world driving datasets have propelled end-to-end autonomous driving. Despite this progress, relying solely on real-world data limits the variety of driving scenarios for training. Synthetic scenario generation has emerged as a promising solution to enrich the diversity of training data; however, its application within E2E AD models remains largely unexplored. This is primarily due to the absence of a designated ego vehicle and the associated sensor inputs, such as camera or LiDAR, typically provided in real-world scenarios. To address this gap, we introduce SynAD, the first framework designed to enhance real-world E2E AD models using synthetic data. Our method designates the agent with the most comprehensive driving information as the ego vehicle in a multi-agent synthetic scenario. We further project path-level scenarios onto maps and employ a newly developed Map-to-BEV Network to derive bird's-eye-view features without relying on sensor inputs. Finally, we devise a training strategy that effectively integrates these map-based synthetic data with real driving data. Experimental results demonstrate that SynAD effectively integrates all components and notably enhances safety performance. By bridging synthetic scenario generation and E2E AD, SynAD paves the way for more comprehensive and robust autonomous driving models.
title SynAD: Enhancing Real-World End-to-End Autonomous Driving Models through Synthetic Data Integration
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2510.24052