CoE: Deep Coupled Embedding for Non-Rigid Point Cloud Correspondences

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zeng, Huajian, Gao, Maolin, Cremers, Daniel
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912181214248960
author Zeng, Huajian
Gao, Maolin
Cremers, Daniel
author_facet Zeng, Huajian
Gao, Maolin
Cremers, Daniel
contents The interest in matching non-rigidly deformed shapes represented as raw point clouds is rising due to the proliferation of low-cost 3D sensors. Yet, the task is challenging since point clouds are irregular and there is a lack of intrinsic shape information. We propose to tackle these challenges by learning a new shape representation -- a per-point high dimensional embedding, in an embedding space where semantically similar points share similar embeddings. The learned embedding has multiple beneficial properties: it is aware of the underlying shape geometry and is robust to shape deformations and various shape artefacts, such as noise and partiality. Consequently, this embedding can be directly employed to retrieve high-quality dense correspondences through a simple nearest neighbor search in the embedding space. Extensive experiments demonstrate new state-of-the-art results and robustness in numerous challenging non-rigid shape matching benchmarks and show its great potential in other shape analysis tasks, such as segmentation.
format Preprint
id arxiv_https___arxiv_org_abs_2412_05557
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle CoE: Deep Coupled Embedding for Non-Rigid Point Cloud Correspondences
Zeng, Huajian
Gao, Maolin
Cremers, Daniel
Computer Vision and Pattern Recognition
The interest in matching non-rigidly deformed shapes represented as raw point clouds is rising due to the proliferation of low-cost 3D sensors. Yet, the task is challenging since point clouds are irregular and there is a lack of intrinsic shape information. We propose to tackle these challenges by learning a new shape representation -- a per-point high dimensional embedding, in an embedding space where semantically similar points share similar embeddings. The learned embedding has multiple beneficial properties: it is aware of the underlying shape geometry and is robust to shape deformations and various shape artefacts, such as noise and partiality. Consequently, this embedding can be directly employed to retrieve high-quality dense correspondences through a simple nearest neighbor search in the embedding space. Extensive experiments demonstrate new state-of-the-art results and robustness in numerous challenging non-rigid shape matching benchmarks and show its great potential in other shape analysis tasks, such as segmentation.
title CoE: Deep Coupled Embedding for Non-Rigid Point Cloud Correspondences
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2412.05557