PointDifformer: Robust Point Cloud Registration With Neural Diffusion and Transformer
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909177474973696 |
|---|---|
| author | She, Rui Kang, Qiyu Wang, Sijie Tay, Wee Peng Zhao, Kai Song, Yang Geng, Tianyu Xu, Yi Navarro, Diego Navarro Hartmannsgruber, Andreas |
| author_facet | She, Rui Kang, Qiyu Wang, Sijie Tay, Wee Peng Zhao, Kai Song, Yang Geng, Tianyu Xu, Yi Navarro, Diego Navarro Hartmannsgruber, Andreas |
| contents | Point cloud registration is a fundamental technique in 3-D computer vision with applications in graphics, autonomous driving, and robotics. However, registration tasks under challenging conditions, under which noise or perturbations are prevalent, can be difficult. We propose a robust point cloud registration approach that leverages graph neural partial differential equations (PDEs) and heat kernel signatures. Our method first uses graph neural PDE modules to extract high dimensional features from point clouds by aggregating information from the 3-D point neighborhood, thereby enhancing the robustness of the feature representations. Then, we incorporate heat kernel signatures into an attention mechanism to efficiently obtain corresponding keypoints. Finally, a singular value decomposition (SVD) module with learnable weights is used to predict the transformation between two point clouds. Empirical experiments on a 3-D point cloud dataset demonstrate that our approach not only achieves state-of-the-art performance for point cloud registration but also exhibits better robustness to additive noise or 3-D shape perturbations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_14034 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | PointDifformer: Robust Point Cloud Registration With Neural Diffusion and Transformer She, Rui Kang, Qiyu Wang, Sijie Tay, Wee Peng Zhao, Kai Song, Yang Geng, Tianyu Xu, Yi Navarro, Diego Navarro Hartmannsgruber, Andreas Computer Vision and Pattern Recognition Point cloud registration is a fundamental technique in 3-D computer vision with applications in graphics, autonomous driving, and robotics. However, registration tasks under challenging conditions, under which noise or perturbations are prevalent, can be difficult. We propose a robust point cloud registration approach that leverages graph neural partial differential equations (PDEs) and heat kernel signatures. Our method first uses graph neural PDE modules to extract high dimensional features from point clouds by aggregating information from the 3-D point neighborhood, thereby enhancing the robustness of the feature representations. Then, we incorporate heat kernel signatures into an attention mechanism to efficiently obtain corresponding keypoints. Finally, a singular value decomposition (SVD) module with learnable weights is used to predict the transformation between two point clouds. Empirical experiments on a 3-D point cloud dataset demonstrate that our approach not only achieves state-of-the-art performance for point cloud registration but also exhibits better robustness to additive noise or 3-D shape perturbations. |
| title | PointDifformer: Robust Point Cloud Registration With Neural Diffusion and Transformer |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2404.14034 |