Defurnishing with X-Ray Vision: Joint Removal of Furniture from Panoramas and Mesh
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866910991546056704 |
|---|---|
| author | Dolhasz, Alan Ma, Chen Gausebeck, Dave Chen, Kevin Miller, Gregor Hayne, Lucas Hovden, Gunnar Sabik, Azwad Brandt, Olaf Slavcheva, Mira |
| author_facet | Dolhasz, Alan Ma, Chen Gausebeck, Dave Chen, Kevin Miller, Gregor Hayne, Lucas Hovden, Gunnar Sabik, Azwad Brandt, Olaf Slavcheva, Mira |
| contents | We present a pipeline for generating defurnished replicas of indoor spaces represented as textured meshes and corresponding multi-view panoramic images. To achieve this, we first segment and remove furniture from the mesh representation, extend planes, and fill holes, obtaining a simplified defurnished mesh (SDM). This SDM acts as an ``X-ray'' of the scene's underlying structure, guiding the defurnishing process. We extract Canny edges from depth and normal images rendered from the SDM. We then use these as a guide to remove the furniture from panorama images via ControlNet inpainting. This control signal ensures the availability of global geometric information that may be hidden from a particular panoramic view by the furniture being removed. The inpainted panoramas are used to texture the mesh. We show that our approach produces higher quality assets than methods that rely on neural radiance fields, which tend to produce blurry low-resolution images, or RGB-D inpainting, which is highly susceptible to hallucinations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_05338 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Defurnishing with X-Ray Vision: Joint Removal of Furniture from Panoramas and Mesh Dolhasz, Alan Ma, Chen Gausebeck, Dave Chen, Kevin Miller, Gregor Hayne, Lucas Hovden, Gunnar Sabik, Azwad Brandt, Olaf Slavcheva, Mira Computer Vision and Pattern Recognition We present a pipeline for generating defurnished replicas of indoor spaces represented as textured meshes and corresponding multi-view panoramic images. To achieve this, we first segment and remove furniture from the mesh representation, extend planes, and fill holes, obtaining a simplified defurnished mesh (SDM). This SDM acts as an ``X-ray'' of the scene's underlying structure, guiding the defurnishing process. We extract Canny edges from depth and normal images rendered from the SDM. We then use these as a guide to remove the furniture from panorama images via ControlNet inpainting. This control signal ensures the availability of global geometric information that may be hidden from a particular panoramic view by the furniture being removed. The inpainted panoramas are used to texture the mesh. We show that our approach produces higher quality assets than methods that rely on neural radiance fields, which tend to produce blurry low-resolution images, or RGB-D inpainting, which is highly susceptible to hallucinations. |
| title | Defurnishing with X-Ray Vision: Joint Removal of Furniture from Panoramas and Mesh |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2506.05338 |