OpenBox: Annotate Any Bounding Boxes in 3D

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Lee, In-Jae, Kim, Mungyeom, Ryu, Kwonyoung, Musacchio, Pierre, Park, Jaesik
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914175945539584
author Lee, In-Jae
Kim, Mungyeom
Ryu, Kwonyoung
Musacchio, Pierre
Park, Jaesik
author_facet Lee, In-Jae
Kim, Mungyeom
Ryu, Kwonyoung
Musacchio, Pierre
Park, Jaesik
contents Unsupervised and open-vocabulary 3D object detection has recently gained attention, particularly in autonomous driving, where reducing annotation costs and recognizing unseen objects are critical for both safety and scalability. However, most existing approaches uniformly annotate 3D bounding boxes, ignore objects' physical states, and require multiple self-training iterations for annotation refinement, resulting in suboptimal quality and substantial computational overhead. To address these challenges, we propose OpenBox, a two-stage automatic annotation pipeline that leverages a 2D vision foundation model. In the first stage, OpenBox associates instance-level cues from 2D images processed by a vision foundation model with the corresponding 3D point clouds via cross-modal instance alignment. In the second stage, it categorizes instances by rigidity and motion state, then generates adaptive bounding boxes with class-specific size statistics. As a result, OpenBox produces high-quality 3D bounding box annotations without requiring self-training. Experiments on the Waymo Open Dataset, the Lyft Level 5 Perception dataset, and the nuScenes dataset demonstrate improved accuracy and efficiency over baselines.
format Preprint
id arxiv_https___arxiv_org_abs_2512_01352
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle OpenBox: Annotate Any Bounding Boxes in 3D
Lee, In-Jae
Kim, Mungyeom
Ryu, Kwonyoung
Musacchio, Pierre
Park, Jaesik
Computer Vision and Pattern Recognition
Unsupervised and open-vocabulary 3D object detection has recently gained attention, particularly in autonomous driving, where reducing annotation costs and recognizing unseen objects are critical for both safety and scalability. However, most existing approaches uniformly annotate 3D bounding boxes, ignore objects' physical states, and require multiple self-training iterations for annotation refinement, resulting in suboptimal quality and substantial computational overhead. To address these challenges, we propose OpenBox, a two-stage automatic annotation pipeline that leverages a 2D vision foundation model. In the first stage, OpenBox associates instance-level cues from 2D images processed by a vision foundation model with the corresponding 3D point clouds via cross-modal instance alignment. In the second stage, it categorizes instances by rigidity and motion state, then generates adaptive bounding boxes with class-specific size statistics. As a result, OpenBox produces high-quality 3D bounding box annotations without requiring self-training. Experiments on the Waymo Open Dataset, the Lyft Level 5 Perception dataset, and the nuScenes dataset demonstrate improved accuracy and efficiency over baselines.
title OpenBox: Annotate Any Bounding Boxes in 3D
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2512.01352