Flash-Splat: 3D Reflection Removal with Flash Cues and Gaussian Splats
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929525788508160 |
|---|---|
| author | Xie, Mingyang Cai, Haoming Shah, Sachin Xu, Yiran Feng, Brandon Y. Huang, Jia-Bin Metzler, Christopher A. |
| author_facet | Xie, Mingyang Cai, Haoming Shah, Sachin Xu, Yiran Feng, Brandon Y. Huang, Jia-Bin Metzler, Christopher A. |
| contents | We introduce a simple yet effective approach for separating transmitted and reflected light. Our key insight is that the powerful novel view synthesis capabilities provided by modern inverse rendering methods (e.g.,~3D Gaussian splatting) allow one to perform flash/no-flash reflection separation using unpaired measurements -- this relaxation dramatically simplifies image acquisition over conventional paired flash/no-flash reflection separation methods. Through extensive real-world experiments, we demonstrate our method, Flash-Splat, accurately reconstructs both transmitted and reflected scenes in 3D. Our method outperforms existing 3D reflection separation methods, which do not leverage illumination control, by a large margin. Our project webpage is at https://flash-splat.github.io/. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_02764 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Flash-Splat: 3D Reflection Removal with Flash Cues and Gaussian Splats Xie, Mingyang Cai, Haoming Shah, Sachin Xu, Yiran Feng, Brandon Y. Huang, Jia-Bin Metzler, Christopher A. Computer Vision and Pattern Recognition Machine Learning Image and Video Processing We introduce a simple yet effective approach for separating transmitted and reflected light. Our key insight is that the powerful novel view synthesis capabilities provided by modern inverse rendering methods (e.g.,~3D Gaussian splatting) allow one to perform flash/no-flash reflection separation using unpaired measurements -- this relaxation dramatically simplifies image acquisition over conventional paired flash/no-flash reflection separation methods. Through extensive real-world experiments, we demonstrate our method, Flash-Splat, accurately reconstructs both transmitted and reflected scenes in 3D. Our method outperforms existing 3D reflection separation methods, which do not leverage illumination control, by a large margin. Our project webpage is at https://flash-splat.github.io/. |
| title | Flash-Splat: 3D Reflection Removal with Flash Cues and Gaussian Splats |
| topic | Computer Vision and Pattern Recognition Machine Learning Image and Video Processing |
| url | https://arxiv.org/abs/2410.02764 |