DriveE2E: Closed-Loop Benchmark for End-to-End Autonomous Driving through Real-to-Simulation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Yu, Haibao, Yang, Wenxian, Hao, Ruiyang, Wang, Chuanye, Zhong, Jiaru, Luo, Ping, Nie, Zaiqing
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909813088190464
author Yu, Haibao
Yang, Wenxian
Hao, Ruiyang
Wang, Chuanye
Zhong, Jiaru
Luo, Ping
Nie, Zaiqing
author_facet Yu, Haibao
Yang, Wenxian
Hao, Ruiyang
Wang, Chuanye
Zhong, Jiaru
Luo, Ping
Nie, Zaiqing
contents Closed-loop evaluation is increasingly critical for end-to-end autonomous driving. Current closed-loop benchmarks using the CARLA simulator rely on manually configured traffic scenarios, which can diverge from real-world conditions, limiting their ability to reflect actual driving performance. To address these limitations, we introduce a simple yet challenging closed-loop evaluation framework that closely integrates real-world driving scenarios into the CARLA simulator with infrastructure cooperation. Our approach involves extracting 800 dynamic traffic scenarios selected from a comprehensive 100-hour video dataset captured by high-mounted infrastructure sensors, and creating static digital twin assets for 15 real-world intersections with consistent visual appearance. These digital twins accurately replicate the traffic and environmental characteristics of their real-world counterparts, enabling more realistic simulations in CARLA. This evaluation is challenging due to the diversity of driving behaviors, locations, weather conditions, and times of day at complex urban intersections. In addition, we provide a comprehensive closed-loop benchmark for evaluating end-to-end autonomous driving models. Project URL: \href{https://github.com/AIR-THU/DriveE2E}{https://github.com/AIR-THU/DriveE2E}.
format Preprint
id arxiv_https___arxiv_org_abs_2509_23922
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DriveE2E: Closed-Loop Benchmark for End-to-End Autonomous Driving through Real-to-Simulation
Yu, Haibao
Yang, Wenxian
Hao, Ruiyang
Wang, Chuanye
Zhong, Jiaru
Luo, Ping
Nie, Zaiqing
Computer Vision and Pattern Recognition
Robotics
Closed-loop evaluation is increasingly critical for end-to-end autonomous driving. Current closed-loop benchmarks using the CARLA simulator rely on manually configured traffic scenarios, which can diverge from real-world conditions, limiting their ability to reflect actual driving performance. To address these limitations, we introduce a simple yet challenging closed-loop evaluation framework that closely integrates real-world driving scenarios into the CARLA simulator with infrastructure cooperation. Our approach involves extracting 800 dynamic traffic scenarios selected from a comprehensive 100-hour video dataset captured by high-mounted infrastructure sensors, and creating static digital twin assets for 15 real-world intersections with consistent visual appearance. These digital twins accurately replicate the traffic and environmental characteristics of their real-world counterparts, enabling more realistic simulations in CARLA. This evaluation is challenging due to the diversity of driving behaviors, locations, weather conditions, and times of day at complex urban intersections. In addition, we provide a comprehensive closed-loop benchmark for evaluating end-to-end autonomous driving models. Project URL: \href{https://github.com/AIR-THU/DriveE2E}{https://github.com/AIR-THU/DriveE2E}.
title DriveE2E: Closed-Loop Benchmark for End-to-End Autonomous Driving through Real-to-Simulation
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2509.23922