SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglement

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Boss, Mark, Huang, Zixuan, Vasishta, Aaryaman, Jampani, Varun
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916342976741376
author Boss, Mark
Huang, Zixuan
Vasishta, Aaryaman
Jampani, Varun
author_facet Boss, Mark
Huang, Zixuan
Vasishta, Aaryaman
Jampani, Varun
contents We present SF3D, a novel method for rapid and high-quality textured object mesh reconstruction from a single image in just 0.5 seconds. Unlike most existing approaches, SF3D is explicitly trained for mesh generation, incorporating a fast UV unwrapping technique that enables swift texture generation rather than relying on vertex colors. The method also learns to predict material parameters and normal maps to enhance the visual quality of the reconstructed 3D meshes. Furthermore, SF3D integrates a delighting step to effectively remove low-frequency illumination effects, ensuring that the reconstructed meshes can be easily used in novel illumination conditions. Experiments demonstrate the superior performance of SF3D over the existing techniques. Project page: https://stable-fast-3d.github.io
format Preprint
id arxiv_https___arxiv_org_abs_2408_00653
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglement
Boss, Mark
Huang, Zixuan
Vasishta, Aaryaman
Jampani, Varun
Computer Vision and Pattern Recognition
Graphics
We present SF3D, a novel method for rapid and high-quality textured object mesh reconstruction from a single image in just 0.5 seconds. Unlike most existing approaches, SF3D is explicitly trained for mesh generation, incorporating a fast UV unwrapping technique that enables swift texture generation rather than relying on vertex colors. The method also learns to predict material parameters and normal maps to enhance the visual quality of the reconstructed 3D meshes. Furthermore, SF3D integrates a delighting step to effectively remove low-frequency illumination effects, ensuring that the reconstructed meshes can be easily used in novel illumination conditions. Experiments demonstrate the superior performance of SF3D over the existing techniques. Project page: https://stable-fast-3d.github.io
title SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglement
topic Computer Vision and Pattern Recognition
Graphics
url https://arxiv.org/abs/2408.00653