4Deform: Neural Surface Deformation for Robust Shape Interpolation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Sang, Lu, Canfes, Zehranaz, Cao, Dongliang, Marin, Riccardo, Bernard, Florian, Cremers, Daniel
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910848274923520
author Sang, Lu
Canfes, Zehranaz
Cao, Dongliang
Marin, Riccardo
Bernard, Florian
Cremers, Daniel
author_facet Sang, Lu
Canfes, Zehranaz
Cao, Dongliang
Marin, Riccardo
Bernard, Florian
Cremers, Daniel
contents Generating realistic intermediate shapes between non-rigidly deformed shapes is a challenging task in computer vision, especially with unstructured data (e.g., point clouds) where temporal consistency across frames is lacking, and topologies are changing. Most interpolation methods are designed for structured data (i.e., meshes) and do not apply to real-world point clouds. In contrast, our approach, 4Deform, leverages neural implicit representation (NIR) to enable free topology changing shape deformation. Unlike previous mesh-based methods that learn vertex-based deformation fields, our method learns a continuous velocity field in Euclidean space. Thus, it is suitable for less structured data such as point clouds. Additionally, our method does not require intermediate-shape supervision during training; instead, we incorporate physical and geometrical constraints to regularize the velocity field. We reconstruct intermediate surfaces using a modified level-set equation, directly linking our NIR with the velocity field. Experiments show that our method significantly outperforms previous NIR approaches across various scenarios (e.g., noisy, partial, topology-changing, non-isometric shapes) and, for the first time, enables new applications like 4D Kinect sequence upsampling and real-world high-resolution mesh deformation.
format Preprint
id arxiv_https___arxiv_org_abs_2502_20208
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle 4Deform: Neural Surface Deformation for Robust Shape Interpolation
Sang, Lu
Canfes, Zehranaz
Cao, Dongliang
Marin, Riccardo
Bernard, Florian
Cremers, Daniel
Computer Vision and Pattern Recognition
Generating realistic intermediate shapes between non-rigidly deformed shapes is a challenging task in computer vision, especially with unstructured data (e.g., point clouds) where temporal consistency across frames is lacking, and topologies are changing. Most interpolation methods are designed for structured data (i.e., meshes) and do not apply to real-world point clouds. In contrast, our approach, 4Deform, leverages neural implicit representation (NIR) to enable free topology changing shape deformation. Unlike previous mesh-based methods that learn vertex-based deformation fields, our method learns a continuous velocity field in Euclidean space. Thus, it is suitable for less structured data such as point clouds. Additionally, our method does not require intermediate-shape supervision during training; instead, we incorporate physical and geometrical constraints to regularize the velocity field. We reconstruct intermediate surfaces using a modified level-set equation, directly linking our NIR with the velocity field. Experiments show that our method significantly outperforms previous NIR approaches across various scenarios (e.g., noisy, partial, topology-changing, non-isometric shapes) and, for the first time, enables new applications like 4D Kinect sequence upsampling and real-world high-resolution mesh deformation.
title 4Deform: Neural Surface Deformation for Robust Shape Interpolation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2502.20208