DrivIng: A Large-Scale Multimodal Driving Dataset with Full Digital Twin Integration

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Rößle, Dominik, Xie, Xujun, Mohan, Adithya, Sambandham, Venkatesh Thirugnana, Cremers, Daniel, Schön, Torsten
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866915761076830208
author Rößle, Dominik
Xie, Xujun
Mohan, Adithya
Sambandham, Venkatesh Thirugnana
Cremers, Daniel
Schön, Torsten
author_facet Rößle, Dominik
Xie, Xujun
Mohan, Adithya
Sambandham, Venkatesh Thirugnana
Cremers, Daniel
Schön, Torsten
contents Perception is a cornerstone of autonomous driving, enabling vehicles to understand their surroundings and make safe, reliable decisions. Developing robust perception algorithms requires large-scale, high-quality datasets that cover diverse driving conditions and support thorough evaluation. Existing datasets often lack a high-fidelity digital twin, limiting systematic testing, edge-case simulation, sensor modification, and sim-to-real evaluations. To address this gap, we present DrivIng, a large-scale multimodal dataset with a complete geo-referenced digital twin of a ~18 km route spanning urban, suburban, and highway segments. Our dataset provides continuous recordings from six RGB cameras, one LiDAR, and high-precision ADMA-based localization, captured across day, dusk, and night. All sequences are annotated at 10 Hz with 3D bounding boxes and track IDs across 12 classes, yielding ~1.2 million annotated instances. Alongside the benefits of a digital twin, DrivIng enables a 1-to-1 transfer of real traffic into simulation, preserving agent interactions while enabling realistic and flexible scenario testing. To support reproducible research and robust validation, we benchmark DrivIng with state-of-the-art perception models and publicly release the dataset, digital twin, HD map, and codebase.
format Preprint
id arxiv_https___arxiv_org_abs_2601_15260
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle DrivIng: A Large-Scale Multimodal Driving Dataset with Full Digital Twin Integration
Rößle, Dominik
Xie, Xujun
Mohan, Adithya
Sambandham, Venkatesh Thirugnana
Cremers, Daniel
Schön, Torsten
Computer Vision and Pattern Recognition
Perception is a cornerstone of autonomous driving, enabling vehicles to understand their surroundings and make safe, reliable decisions. Developing robust perception algorithms requires large-scale, high-quality datasets that cover diverse driving conditions and support thorough evaluation. Existing datasets often lack a high-fidelity digital twin, limiting systematic testing, edge-case simulation, sensor modification, and sim-to-real evaluations. To address this gap, we present DrivIng, a large-scale multimodal dataset with a complete geo-referenced digital twin of a ~18 km route spanning urban, suburban, and highway segments. Our dataset provides continuous recordings from six RGB cameras, one LiDAR, and high-precision ADMA-based localization, captured across day, dusk, and night. All sequences are annotated at 10 Hz with 3D bounding boxes and track IDs across 12 classes, yielding ~1.2 million annotated instances. Alongside the benefits of a digital twin, DrivIng enables a 1-to-1 transfer of real traffic into simulation, preserving agent interactions while enabling realistic and flexible scenario testing. To support reproducible research and robust validation, we benchmark DrivIng with state-of-the-art perception models and publicly release the dataset, digital twin, HD map, and codebase.
title DrivIng: A Large-Scale Multimodal Driving Dataset with Full Digital Twin Integration
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2601.15260