Cross3DReg: Towards a Large-scale Real-world Cross-source Point Cloud Registration Benchmark

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xu, Zongyi, Lang, Zhongpeng, Chen, Yilong, Zhao, Shanshan, Huang, Xiaoshui, Zuo, Yifan, Zhang, Yan, Zhang, Qianni, Gao, Xinbo
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909775686533120
author Xu, Zongyi
Lang, Zhongpeng
Chen, Yilong
Zhao, Shanshan
Huang, Xiaoshui
Zuo, Yifan
Zhang, Yan
Zhang, Qianni
Gao, Xinbo
author_facet Xu, Zongyi
Lang, Zhongpeng
Chen, Yilong
Zhao, Shanshan
Huang, Xiaoshui
Zuo, Yifan
Zhang, Yan
Zhang, Qianni
Gao, Xinbo
contents Cross-source point cloud registration, which aims to align point cloud data from different sensors, is a fundamental task in 3D vision. However, compared to the same-source point cloud registration, cross-source registration faces two core challenges: the lack of publicly available large-scale real-world datasets for training the deep registration models, and the inherent differences in point clouds captured by multiple sensors. The diverse patterns induced by the sensors pose great challenges in robust and accurate point cloud feature extraction and matching, which negatively influence the registration accuracy. To advance research in this field, we construct Cross3DReg, the currently largest and real-world multi-modal cross-source point cloud registration dataset, which is collected by a rotating mechanical lidar and a hybrid semi-solid-state lidar, respectively. Moreover, we design an overlap-based cross-source registration framework, which utilizes unaligned images to predict the overlapping region between source and target point clouds, effectively filtering out redundant points in the irrelevant regions and significantly mitigating the interference caused by noise in non-overlapping areas. Then, a visual-geometric attention guided matching module is proposed to enhance the consistency of cross-source point cloud features by fusing image and geometric information to establish reliable correspondences and ultimately achieve accurate and robust registration. Extensive experiments show that our method achieves state-of-the-art registration performance. Our framework reduces the relative rotation error (RRE) and relative translation error (RTE) by $63.2\%$ and $40.2\%$, respectively, and improves the registration recall (RR) by $5.4\%$, which validates its effectiveness in achieving accurate cross-source registration.
format Preprint
id arxiv_https___arxiv_org_abs_2509_06456
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Cross3DReg: Towards a Large-scale Real-world Cross-source Point Cloud Registration Benchmark
Xu, Zongyi
Lang, Zhongpeng
Chen, Yilong
Zhao, Shanshan
Huang, Xiaoshui
Zuo, Yifan
Zhang, Yan
Zhang, Qianni
Gao, Xinbo
Computer Vision and Pattern Recognition
Cross-source point cloud registration, which aims to align point cloud data from different sensors, is a fundamental task in 3D vision. However, compared to the same-source point cloud registration, cross-source registration faces two core challenges: the lack of publicly available large-scale real-world datasets for training the deep registration models, and the inherent differences in point clouds captured by multiple sensors. The diverse patterns induced by the sensors pose great challenges in robust and accurate point cloud feature extraction and matching, which negatively influence the registration accuracy. To advance research in this field, we construct Cross3DReg, the currently largest and real-world multi-modal cross-source point cloud registration dataset, which is collected by a rotating mechanical lidar and a hybrid semi-solid-state lidar, respectively. Moreover, we design an overlap-based cross-source registration framework, which utilizes unaligned images to predict the overlapping region between source and target point clouds, effectively filtering out redundant points in the irrelevant regions and significantly mitigating the interference caused by noise in non-overlapping areas. Then, a visual-geometric attention guided matching module is proposed to enhance the consistency of cross-source point cloud features by fusing image and geometric information to establish reliable correspondences and ultimately achieve accurate and robust registration. Extensive experiments show that our method achieves state-of-the-art registration performance. Our framework reduces the relative rotation error (RRE) and relative translation error (RTE) by $63.2\%$ and $40.2\%$, respectively, and improves the registration recall (RR) by $5.4\%$, which validates its effectiveness in achieving accurate cross-source registration.
title Cross3DReg: Towards a Large-scale Real-world Cross-source Point Cloud Registration Benchmark
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2509.06456