Fully-Geometric Cross-Attention for Point Cloud Registration

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Wang, Weijie, Mei, Guofeng, Zhang, Jian, Sebe, Nicu, Lepri, Bruno, Poiesi, Fabio
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913884340748288
author Wang, Weijie
Mei, Guofeng
Zhang, Jian
Sebe, Nicu
Lepri, Bruno
Poiesi, Fabio
author_facet Wang, Weijie
Mei, Guofeng
Zhang, Jian
Sebe, Nicu
Lepri, Bruno
Poiesi, Fabio
contents Point cloud registration approaches often fail when the overlap between point clouds is low due to noisy point correspondences. This work introduces a novel cross-attention mechanism tailored for Transformer-based architectures that tackles this problem, by fusing information from coordinates and features at the super-point level between point clouds. This formulation has remained unexplored primarily because it must guarantee rotation and translation invariance since point clouds reside in different and independent reference frames. We integrate the Gromov-Wasserstein distance into the cross-attention formulation to jointly compute distances between points across different point clouds and account for their geometric structure. By doing so, points from two distinct point clouds can attend to each other under arbitrary rigid transformations. At the point level, we also devise a self-attention mechanism that aggregates the local geometric structure information into point features for fine matching. Our formulation boosts the number of inlier correspondences, thereby yielding more precise registration results compared to state-of-the-art approaches. We have conducted an extensive evaluation on 3DMatch, 3DLoMatch, KITTI, and 3DCSR datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2502_08285
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Fully-Geometric Cross-Attention for Point Cloud Registration
Wang, Weijie
Mei, Guofeng
Zhang, Jian
Sebe, Nicu
Lepri, Bruno
Poiesi, Fabio
Computer Vision and Pattern Recognition
Point cloud registration approaches often fail when the overlap between point clouds is low due to noisy point correspondences. This work introduces a novel cross-attention mechanism tailored for Transformer-based architectures that tackles this problem, by fusing information from coordinates and features at the super-point level between point clouds. This formulation has remained unexplored primarily because it must guarantee rotation and translation invariance since point clouds reside in different and independent reference frames. We integrate the Gromov-Wasserstein distance into the cross-attention formulation to jointly compute distances between points across different point clouds and account for their geometric structure. By doing so, points from two distinct point clouds can attend to each other under arbitrary rigid transformations. At the point level, we also devise a self-attention mechanism that aggregates the local geometric structure information into point features for fine matching. Our formulation boosts the number of inlier correspondences, thereby yielding more precise registration results compared to state-of-the-art approaches. We have conducted an extensive evaluation on 3DMatch, 3DLoMatch, KITTI, and 3DCSR datasets.
title Fully-Geometric Cross-Attention for Point Cloud Registration
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2502.08285