ESCAPE: Equivariant Shape Completion via Anchor Point Encoding

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Bekci, Burak, Navab, Nassir, Tombari, Federico, Saleh, Mahdi
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929609701851136
author Bekci, Burak
Navab, Nassir
Tombari, Federico
Saleh, Mahdi
author_facet Bekci, Burak
Navab, Nassir
Tombari, Federico
Saleh, Mahdi
contents Shape completion, a crucial task in 3D computer vision, involves predicting and filling the missing regions of scanned or partially observed objects. Current methods expect known pose or canonical coordinates and do not perform well under varying rotations, limiting their real-world applicability. We introduce ESCAPE (Equivariant Shape Completion via Anchor Point Encoding), a novel framework designed to achieve rotation-equivariant shape completion. Our approach employs a distinctive encoding strategy by selecting anchor points from a shape and representing all points as a distance to all anchor points. This enables the model to capture a consistent, rotation-equivariant understanding of the object's geometry. ESCAPE leverages a transformer architecture to encode and decode the distance transformations, ensuring that generated shape completions remain accurate and equivariant under rotational transformations. Subsequently, we perform optimization to calculate the predicted shapes from the encodings. Experimental evaluations demonstrate that ESCAPE achieves robust, high-quality reconstructions across arbitrary rotations and translations, showcasing its effectiveness in real-world applications without additional pose estimation modules.
format Preprint
id arxiv_https___arxiv_org_abs_2412_00952
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle ESCAPE: Equivariant Shape Completion via Anchor Point Encoding
Bekci, Burak
Navab, Nassir
Tombari, Federico
Saleh, Mahdi
Computer Vision and Pattern Recognition
Shape completion, a crucial task in 3D computer vision, involves predicting and filling the missing regions of scanned or partially observed objects. Current methods expect known pose or canonical coordinates and do not perform well under varying rotations, limiting their real-world applicability. We introduce ESCAPE (Equivariant Shape Completion via Anchor Point Encoding), a novel framework designed to achieve rotation-equivariant shape completion. Our approach employs a distinctive encoding strategy by selecting anchor points from a shape and representing all points as a distance to all anchor points. This enables the model to capture a consistent, rotation-equivariant understanding of the object's geometry. ESCAPE leverages a transformer architecture to encode and decode the distance transformations, ensuring that generated shape completions remain accurate and equivariant under rotational transformations. Subsequently, we perform optimization to calculate the predicted shapes from the encodings. Experimental evaluations demonstrate that ESCAPE achieves robust, high-quality reconstructions across arbitrary rotations and translations, showcasing its effectiveness in real-world applications without additional pose estimation modules.
title ESCAPE: Equivariant Shape Completion via Anchor Point Encoding
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2412.00952