From Virtual Environments to Real-World Trials: Emerging Trends in Autonomous Driving

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Humnabadkar, A., Sikdar, A., Cave, B., Zhang, H., Bessis, N., Behera, A.
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911564163973120
author Humnabadkar, A.
Sikdar, A.
Cave, B.
Zhang, H.
Bessis, N.
Behera, A.
author_facet Humnabadkar, A.
Sikdar, A.
Cave, B.
Zhang, H.
Bessis, N.
Behera, A.
contents Autonomous driving technologies have achieved significant advances in recent years, yet their real-world deployment remains constrained by data scarcity, safety requirements, and the need for generalization across diverse environments. In response, synthetic data and virtual environments have emerged as powerful enablers, offering scalable, controllable, and richly annotated scenarios for training and evaluation. This survey presents a comprehensive review of recent developments at the intersection of autonomous driving, simulation technologies, and synthetic datasets. We organize the landscape across three core dimensions: (i) the use of synthetic data for perception and planning, (ii) digital twin-based simulation for system validation, and (iii) domain adaptation strategies bridging synthetic and real-world data. We also highlight the role of vision-language models and simulation realism in enhancing scene understanding and generalization. A detailed taxonomy of datasets, tools, and simulation platforms is provided, alongside an analysis of trends in benchmark design. Finally, we discuss critical challenges and open research directions, including Sim2Real transfer, scalable safety validation, cooperative autonomy, and simulation-driven policy learning, that must be addressed to accelerate the path toward safe, generalizable, and globally deployable autonomous driving systems.
format Preprint
id arxiv_https___arxiv_org_abs_2603_17714
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle From Virtual Environments to Real-World Trials: Emerging Trends in Autonomous Driving
Humnabadkar, A.
Sikdar, A.
Cave, B.
Zhang, H.
Bessis, N.
Behera, A.
Artificial Intelligence
Autonomous driving technologies have achieved significant advances in recent years, yet their real-world deployment remains constrained by data scarcity, safety requirements, and the need for generalization across diverse environments. In response, synthetic data and virtual environments have emerged as powerful enablers, offering scalable, controllable, and richly annotated scenarios for training and evaluation. This survey presents a comprehensive review of recent developments at the intersection of autonomous driving, simulation technologies, and synthetic datasets. We organize the landscape across three core dimensions: (i) the use of synthetic data for perception and planning, (ii) digital twin-based simulation for system validation, and (iii) domain adaptation strategies bridging synthetic and real-world data. We also highlight the role of vision-language models and simulation realism in enhancing scene understanding and generalization. A detailed taxonomy of datasets, tools, and simulation platforms is provided, alongside an analysis of trends in benchmark design. Finally, we discuss critical challenges and open research directions, including Sim2Real transfer, scalable safety validation, cooperative autonomy, and simulation-driven policy learning, that must be addressed to accelerate the path toward safe, generalizable, and globally deployable autonomous driving systems.
title From Virtual Environments to Real-World Trials: Emerging Trends in Autonomous Driving
topic Artificial Intelligence
url https://arxiv.org/abs/2603.17714