Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2410.01719 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916607648858112 |
|---|---|
| author | Xu, Jiamin Li, Zelong Zheng, Yuxin Huang, Chenyu Gu, Renshu Xu, Weiwei Xu, Gang |
| author_facet | Xu, Jiamin Li, Zelong Zheng, Yuxin Huang, Chenyu Gu, Renshu Xu, Weiwei Xu, Gang |
| contents | Shadows can originate from occlusions in both direct and indirect illumination. Although most current shadow removal research focuses on shadows caused by direct illumination, shadows from indirect illumination are often just as pervasive, particularly in indoor scenes. A significant challenge in removing shadows from indirect illumination is obtaining shadow-free images to train the shadow removal network. To overcome this challenge, we propose a novel rendering pipeline for generating shadowed and shadow-free images under direct and indirect illumination, and create a comprehensive synthetic dataset that contains over 30,000 image pairs, covering various object types and lighting conditions. We also propose an innovative shadow removal network that explicitly integrates semantic and geometric priors through concatenation and attention mechanisms. The experiments show that our method outperforms state-of-the-art shadow removal techniques and can effectively generalize to indoor and outdoor scenes under various lighting conditions, enhancing the overall effectiveness and applicability of shadow removal methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_01719 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | OmniSR: Shadow Removal under Direct and Indirect Lighting Xu, Jiamin Li, Zelong Zheng, Yuxin Huang, Chenyu Gu, Renshu Xu, Weiwei Xu, Gang Computer Vision and Pattern Recognition Shadows can originate from occlusions in both direct and indirect illumination. Although most current shadow removal research focuses on shadows caused by direct illumination, shadows from indirect illumination are often just as pervasive, particularly in indoor scenes. A significant challenge in removing shadows from indirect illumination is obtaining shadow-free images to train the shadow removal network. To overcome this challenge, we propose a novel rendering pipeline for generating shadowed and shadow-free images under direct and indirect illumination, and create a comprehensive synthetic dataset that contains over 30,000 image pairs, covering various object types and lighting conditions. We also propose an innovative shadow removal network that explicitly integrates semantic and geometric priors through concatenation and attention mechanisms. The experiments show that our method outperforms state-of-the-art shadow removal techniques and can effectively generalize to indoor and outdoor scenes under various lighting conditions, enhancing the overall effectiveness and applicability of shadow removal methods. |
| title | OmniSR: Shadow Removal under Direct and Indirect Lighting |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2410.01719 |