TaCarla: A comprehensive benchmarking dataset for end-to-end autonomous driving

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Gorgulu, Tugrul, Dag, Atakan, Kalfaoglu, M. Esat, Kuru, Halil Ibrahim, Cam, Baris Can, Ozturk, Halil Ibrahim, Kilinc, Ozsel
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912999267106816
author Gorgulu, Tugrul
Dag, Atakan
Kalfaoglu, M. Esat
Kuru, Halil Ibrahim
Cam, Baris Can
Ozturk, Halil Ibrahim
Kilinc, Ozsel
author_facet Gorgulu, Tugrul
Dag, Atakan
Kalfaoglu, M. Esat
Kuru, Halil Ibrahim
Cam, Baris Can
Ozturk, Halil Ibrahim
Kilinc, Ozsel
contents Collecting a high-quality dataset is a critical task that demands meticulous attention to detail, as overlooking certain aspects can render the entire dataset unusable. Autonomous driving challenges remain a prominent area of research, requiring further exploration to enhance the perception and planning performance of vehicles. However, existing datasets are often incomplete. For instance, datasets that include perception information generally lack planning data, while planning datasets typically consist of extensive driving sequences where the ego vehicle predominantly drives forward, offering limited behavioral diversity. In addition, many real datasets struggle to evaluate their models, especially for planning tasks, since they lack a proper closed-loop evaluation setup. The CARLA Leaderboard 2.0 challenge, which provides a diverse set of scenarios to address the long-tail problem in autonomous driving, has emerged as a valuable alternative platform for developing perception and planning models in both open-loop and closed-loop evaluation setups. Nevertheless, existing datasets collected on this platform present certain limitations. Some datasets appear to be tailored primarily for limited sensor configuration, with particular sensor configurations. To support end-to-end autonomous driving research, we have collected a new dataset comprising over 2.85 million frames using the CARLA simulation environment for the diverse Leaderboard 2.0 challenge scenarios. Our dataset is designed not only for planning tasks but also supports dynamic object detection, lane divider detection, centerline detection, traffic light recognition, prediction tasks and visual language action models . Furthermore, we demonstrate its versatility by training various models using our dataset. Moreover, we also provide numerical rarity scores to understand how rarely the current state occurs in the dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2602_23499
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle TaCarla: A comprehensive benchmarking dataset for end-to-end autonomous driving
Gorgulu, Tugrul
Dag, Atakan
Kalfaoglu, M. Esat
Kuru, Halil Ibrahim
Cam, Baris Can
Ozturk, Halil Ibrahim
Kilinc, Ozsel
Robotics
Artificial Intelligence
Collecting a high-quality dataset is a critical task that demands meticulous attention to detail, as overlooking certain aspects can render the entire dataset unusable. Autonomous driving challenges remain a prominent area of research, requiring further exploration to enhance the perception and planning performance of vehicles. However, existing datasets are often incomplete. For instance, datasets that include perception information generally lack planning data, while planning datasets typically consist of extensive driving sequences where the ego vehicle predominantly drives forward, offering limited behavioral diversity. In addition, many real datasets struggle to evaluate their models, especially for planning tasks, since they lack a proper closed-loop evaluation setup. The CARLA Leaderboard 2.0 challenge, which provides a diverse set of scenarios to address the long-tail problem in autonomous driving, has emerged as a valuable alternative platform for developing perception and planning models in both open-loop and closed-loop evaluation setups. Nevertheless, existing datasets collected on this platform present certain limitations. Some datasets appear to be tailored primarily for limited sensor configuration, with particular sensor configurations. To support end-to-end autonomous driving research, we have collected a new dataset comprising over 2.85 million frames using the CARLA simulation environment for the diverse Leaderboard 2.0 challenge scenarios. Our dataset is designed not only for planning tasks but also supports dynamic object detection, lane divider detection, centerline detection, traffic light recognition, prediction tasks and visual language action models . Furthermore, we demonstrate its versatility by training various models using our dataset. Moreover, we also provide numerical rarity scores to understand how rarely the current state occurs in the dataset.
title TaCarla: A comprehensive benchmarking dataset for end-to-end autonomous driving
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2602.23499