Parameterization-driven Neural Surface Reconstruction for Object-oriented Editing in Neural Rendering
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910525625991168 |
|---|---|
| author | Xu, Baixin Hu, Jiangbei Hou, Fei Lin, Kwan-Yee Wu, Wayne Qian, Chen He, Ying |
| author_facet | Xu, Baixin Hu, Jiangbei Hou, Fei Lin, Kwan-Yee Wu, Wayne Qian, Chen He, Ying |
| contents | The advancements in neural rendering have increased the need for techniques that enable intuitive editing of 3D objects represented as neural implicit surfaces. This paper introduces a novel neural algorithm for parameterizing neural implicit surfaces to simple parametric domains like spheres and polycubes. Our method allows users to specify the number of cubes in the parametric domain, learning a configuration that closely resembles the target 3D object's geometry. It computes bi-directional deformation between the object and the domain using a forward mapping from the object's zero level set and an inverse deformation for backward mapping. We ensure nearly bijective mapping with a cycle loss and optimize deformation smoothness. The parameterization quality, assessed by angle and area distortions, is guaranteed using a Laplacian regularizer and an optimized learned parametric domain. Our framework integrates with existing neural rendering pipelines, using multi-view images of a single object or multiple objects of similar geometries to reconstruct 3D geometry and compute texture maps automatically, eliminating the need for any prior information. We demonstrate the method's effectiveness on images of human heads and man-made objects. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2310_05524 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Parameterization-driven Neural Surface Reconstruction for Object-oriented Editing in Neural Rendering Xu, Baixin Hu, Jiangbei Hou, Fei Lin, Kwan-Yee Wu, Wayne Qian, Chen He, Ying Computer Vision and Pattern Recognition The advancements in neural rendering have increased the need for techniques that enable intuitive editing of 3D objects represented as neural implicit surfaces. This paper introduces a novel neural algorithm for parameterizing neural implicit surfaces to simple parametric domains like spheres and polycubes. Our method allows users to specify the number of cubes in the parametric domain, learning a configuration that closely resembles the target 3D object's geometry. It computes bi-directional deformation between the object and the domain using a forward mapping from the object's zero level set and an inverse deformation for backward mapping. We ensure nearly bijective mapping with a cycle loss and optimize deformation smoothness. The parameterization quality, assessed by angle and area distortions, is guaranteed using a Laplacian regularizer and an optimized learned parametric domain. Our framework integrates with existing neural rendering pipelines, using multi-view images of a single object or multiple objects of similar geometries to reconstruct 3D geometry and compute texture maps automatically, eliminating the need for any prior information. We demonstrate the method's effectiveness on images of human heads and man-made objects. |
| title | Parameterization-driven Neural Surface Reconstruction for Object-oriented Editing in Neural Rendering |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2310.05524 |