ShadowRefiner: Towards Mask-free Shadow Removal via Fast Fourier Transformer
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929407589875712 |
|---|---|
| author | Dong, Wei Zhou, Han Tian, Yuqiong Sun, Jingke Liu, Xiaohong Zhai, Guangtao Chen, Jun |
| author_facet | Dong, Wei Zhou, Han Tian, Yuqiong Sun, Jingke Liu, Xiaohong Zhai, Guangtao Chen, Jun |
| contents | Shadow-affected images often exhibit pronounced spatial discrepancies in color and illumination, consequently degrading various vision applications including object detection and segmentation systems. To effectively eliminate shadows in real-world images while preserving intricate details and producing visually compelling outcomes, we introduce a mask-free Shadow Removal and Refinement network (ShadowRefiner) via Fast Fourier Transformer. Specifically, the Shadow Removal module in our method aims to establish effective mappings between shadow-affected and shadow-free images via spatial and frequency representation learning. To mitigate the pixel misalignment and further improve the image quality, we propose a novel Fast-Fourier Attention based Transformer (FFAT) architecture, where an innovative attention mechanism is designed for meticulous refinement. Our method wins the championship in the Perceptual Track and achieves the second best performance in the Fidelity Track of NTIRE 2024 Image Shadow Removal Challenge. Besides, comprehensive experiment result also demonstrate the compelling effectiveness of our proposed method. The code is publicly available: https://github.com/movingforward100/Shadow_R. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_02559 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | ShadowRefiner: Towards Mask-free Shadow Removal via Fast Fourier Transformer Dong, Wei Zhou, Han Tian, Yuqiong Sun, Jingke Liu, Xiaohong Zhai, Guangtao Chen, Jun Computer Vision and Pattern Recognition Shadow-affected images often exhibit pronounced spatial discrepancies in color and illumination, consequently degrading various vision applications including object detection and segmentation systems. To effectively eliminate shadows in real-world images while preserving intricate details and producing visually compelling outcomes, we introduce a mask-free Shadow Removal and Refinement network (ShadowRefiner) via Fast Fourier Transformer. Specifically, the Shadow Removal module in our method aims to establish effective mappings between shadow-affected and shadow-free images via spatial and frequency representation learning. To mitigate the pixel misalignment and further improve the image quality, we propose a novel Fast-Fourier Attention based Transformer (FFAT) architecture, where an innovative attention mechanism is designed for meticulous refinement. Our method wins the championship in the Perceptual Track and achieves the second best performance in the Fidelity Track of NTIRE 2024 Image Shadow Removal Challenge. Besides, comprehensive experiment result also demonstrate the compelling effectiveness of our proposed method. The code is publicly available: https://github.com/movingforward100/Shadow_R. |
| title | ShadowRefiner: Towards Mask-free Shadow Removal via Fast Fourier Transformer |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2406.02559 |