Saved in:
Bibliographic Details
Main Authors: Miro, Alexandre Justo, Klinteberg, Ludvig af, Timus, Bogdan, Asefaw, Aron, Khoche, Ajinkya, Gustafsson, Thomas, Mansouri, Sina Sharif, Daneshtalab, Masoud
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2601.14038
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912835132456960
author Miro, Alexandre Justo
Klinteberg, Ludvig af
Timus, Bogdan
Asefaw, Aron
Khoche, Ajinkya
Gustafsson, Thomas
Mansouri, Sina Sharif
Daneshtalab, Masoud
author_facet Miro, Alexandre Justo
Klinteberg, Ludvig af
Timus, Bogdan
Asefaw, Aron
Khoche, Ajinkya
Gustafsson, Thomas
Mansouri, Sina Sharif
Daneshtalab, Masoud
contents Accurate ground truth annotations are critical to supervised learning and evaluating the performance of autonomous vehicle systems. These vehicles are typically equipped with active sensors, such as LiDAR, which scan the environment in predefined patterns. 3D box annotation based on data from such sensors is challenging in dynamic scenarios, where objects are observed at different timestamps, hence different positions. Without proper handling of this phenomenon, systematic errors are prone to being introduced in the box annotations. Our work is the first to discover such annotation errors in widely used, publicly available datasets. Through our novel offline estimation method, we correct the annotations so that they follow physically feasible trajectories and achieve spatial and temporal consistency with the sensor data. For the first time, we define metrics for this problem; and we evaluate our method on the Argoverse 2, MAN TruckScenes, and our proprietary datasets. Our approach increases the quality of box annotations by more than 17% in these datasets. Furthermore, we quantify the annotation errors in them and find that the original annotations are misplaced by up to 2.5 m, with highly dynamic objects being the most affected. Finally, we test the impact of the errors in benchmarking and find that the impact is larger than the improvements that state-of-the-art methods typically achieve with respect to the previous state-of-the-art methods; showing that accurate annotations are essential for correct interpretation of performance. Our code is available at https://github.com/alexandre-justo-miro/annotation-correction-3D-boxes.
format Preprint
id arxiv_https___arxiv_org_abs_2601_14038
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Correcting and Quantifying Systematic Errors in 3D Box Annotations for Autonomous Driving
Miro, Alexandre Justo
Klinteberg, Ludvig af
Timus, Bogdan
Asefaw, Aron
Khoche, Ajinkya
Gustafsson, Thomas
Mansouri, Sina Sharif
Daneshtalab, Masoud
Computer Vision and Pattern Recognition
Accurate ground truth annotations are critical to supervised learning and evaluating the performance of autonomous vehicle systems. These vehicles are typically equipped with active sensors, such as LiDAR, which scan the environment in predefined patterns. 3D box annotation based on data from such sensors is challenging in dynamic scenarios, where objects are observed at different timestamps, hence different positions. Without proper handling of this phenomenon, systematic errors are prone to being introduced in the box annotations. Our work is the first to discover such annotation errors in widely used, publicly available datasets. Through our novel offline estimation method, we correct the annotations so that they follow physically feasible trajectories and achieve spatial and temporal consistency with the sensor data. For the first time, we define metrics for this problem; and we evaluate our method on the Argoverse 2, MAN TruckScenes, and our proprietary datasets. Our approach increases the quality of box annotations by more than 17% in these datasets. Furthermore, we quantify the annotation errors in them and find that the original annotations are misplaced by up to 2.5 m, with highly dynamic objects being the most affected. Finally, we test the impact of the errors in benchmarking and find that the impact is larger than the improvements that state-of-the-art methods typically achieve with respect to the previous state-of-the-art methods; showing that accurate annotations are essential for correct interpretation of performance. Our code is available at https://github.com/alexandre-justo-miro/annotation-correction-3D-boxes.
title Correcting and Quantifying Systematic Errors in 3D Box Annotations for Autonomous Driving
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2601.14038