MT-PCR: Leveraging Modality Transformation for Large-Scale Point Cloud Registration with Limited Overlap

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wu, Yilong, Duan, Yifan, Chen, Yuxi, Zhang, Xinran, Shen, Yedong, Ji, Jianmin, Zhang, Yanyong, Zhang, Lu
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912277619277824
author Wu, Yilong
Duan, Yifan
Chen, Yuxi
Zhang, Xinran
Shen, Yedong
Ji, Jianmin
Zhang, Yanyong
Zhang, Lu
author_facet Wu, Yilong
Duan, Yifan
Chen, Yuxi
Zhang, Xinran
Shen, Yedong
Ji, Jianmin
Zhang, Yanyong
Zhang, Lu
contents Large-scale scene point cloud registration with limited overlap is a challenging task due to computational load and constrained data acquisition. To tackle these issues, we propose a point cloud registration method, MT-PCR, based on Modality Transformation. MT-PCR leverages a BEV capturing the maximal overlap information to improve the accuracy and utilizes images to provide complementary spatial features. Specifically, MT-PCR converts 3D point clouds to BEV images and eastimates correspondence by 2D image keypoints extraction and matching. Subsequently, the 2D correspondence estimates are then transformed back to 3D point clouds using inverse mapping. We have applied MT-PCR to Terrestrial Laser Scanning and Aerial Laser Scanning point cloud registration on the GrAco dataset, involving 8 low-overlap, square-kilometer scale registration scenarios. Experiments and comparisons with commonly used methods demonstrate that MT-PCR can achieve superior accuracy and robustness in large-scale scenes with limited overlap.
format Preprint
id arxiv_https___arxiv_org_abs_2503_12833
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MT-PCR: Leveraging Modality Transformation for Large-Scale Point Cloud Registration with Limited Overlap
Wu, Yilong
Duan, Yifan
Chen, Yuxi
Zhang, Xinran
Shen, Yedong
Ji, Jianmin
Zhang, Yanyong
Zhang, Lu
Robotics
Large-scale scene point cloud registration with limited overlap is a challenging task due to computational load and constrained data acquisition. To tackle these issues, we propose a point cloud registration method, MT-PCR, based on Modality Transformation. MT-PCR leverages a BEV capturing the maximal overlap information to improve the accuracy and utilizes images to provide complementary spatial features. Specifically, MT-PCR converts 3D point clouds to BEV images and eastimates correspondence by 2D image keypoints extraction and matching. Subsequently, the 2D correspondence estimates are then transformed back to 3D point clouds using inverse mapping. We have applied MT-PCR to Terrestrial Laser Scanning and Aerial Laser Scanning point cloud registration on the GrAco dataset, involving 8 low-overlap, square-kilometer scale registration scenarios. Experiments and comparisons with commonly used methods demonstrate that MT-PCR can achieve superior accuracy and robustness in large-scale scenes with limited overlap.
title MT-PCR: Leveraging Modality Transformation for Large-Scale Point Cloud Registration with Limited Overlap
topic Robotics
url https://arxiv.org/abs/2503.12833