Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2411.18311 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917916678553600 |
|---|---|
| author | Szymkowiak, Jakub Jakubowska, Weronika Malarz, Dawid Smolak-Dyżewska, Weronika Zięba, Maciej Musialski, Przemyslaw Pałubicki, Wojtek Spurek, Przemysław |
| author_facet | Szymkowiak, Jakub Jakubowska, Weronika Malarz, Dawid Smolak-Dyżewska, Weronika Zięba, Maciej Musialski, Przemyslaw Pałubicki, Wojtek Spurek, Przemysław |
| contents | In computer graphics and vision, recovering easily modifiable scene appearance from image data is crucial for applications such as content creation. We introduce a novel method that integrates 3D Gaussian Splatting with an implicit surface representation, enabling intuitive editing of recovered scenes through mesh manipulation. Starting with a set of input images and camera poses, our approach reconstructs the scene surface using a neural signed distance field. This neural surface acts as a geometric prior guiding the training of Gaussian Splatting components, ensuring their alignment with the scene geometry. To facilitate editing, we encode the visual and geometric information into a lightweight triangle soup proxy. Edits applied to the mesh extracted from the neural surface propagate seamlessly through this intermediate structure to update the recovered appearance. Unlike previous methods relying on the triangle soup proxy representation, our approach supports a wider range of modifications and fully leverages the mesh topology, enabling a more flexible and intuitive editing process. The complete source code for this project can be accessed at: https://github.com/WJakubowska/NeuralSurfacePriors. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_18311 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Neural Surface Priors for Editable Gaussian Splatting Szymkowiak, Jakub Jakubowska, Weronika Malarz, Dawid Smolak-Dyżewska, Weronika Zięba, Maciej Musialski, Przemyslaw Pałubicki, Wojtek Spurek, Przemysław Computer Vision and Pattern Recognition In computer graphics and vision, recovering easily modifiable scene appearance from image data is crucial for applications such as content creation. We introduce a novel method that integrates 3D Gaussian Splatting with an implicit surface representation, enabling intuitive editing of recovered scenes through mesh manipulation. Starting with a set of input images and camera poses, our approach reconstructs the scene surface using a neural signed distance field. This neural surface acts as a geometric prior guiding the training of Gaussian Splatting components, ensuring their alignment with the scene geometry. To facilitate editing, we encode the visual and geometric information into a lightweight triangle soup proxy. Edits applied to the mesh extracted from the neural surface propagate seamlessly through this intermediate structure to update the recovered appearance. Unlike previous methods relying on the triangle soup proxy representation, our approach supports a wider range of modifications and fully leverages the mesh topology, enabling a more flexible and intuitive editing process. The complete source code for this project can be accessed at: https://github.com/WJakubowska/NeuralSurfacePriors. |
| title | Neural Surface Priors for Editable Gaussian Splatting |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2411.18311 |