Guardado en:
Detalles Bibliográficos
Autores principales: Cai, Jie, Yang, Kangning, Ouyang, Ling, Fu, Lan, Ding, Jiaming, Sun, Huiming, Ho, Chiu Man, Meng, Zibo
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:https://arxiv.org/abs/2506.05489
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916781324500992
author Cai, Jie
Yang, Kangning
Ouyang, Ling
Fu, Lan
Ding, Jiaming
Sun, Huiming
Ho, Chiu Man
Meng, Zibo
author_facet Cai, Jie
Yang, Kangning
Ouyang, Ling
Fu, Lan
Ding, Jiaming
Sun, Huiming
Ho, Chiu Man
Meng, Zibo
contents Single Image Reflection Removal (SIRR) technique plays a crucial role in image processing by eliminating unwanted reflections from the background. These reflections, often caused by photographs taken through glass surfaces, can significantly degrade image quality. SIRR remains a challenging problem due to the complex and varied reflections encountered in real-world scenarios. These reflections vary significantly in intensity, shapes, light sources, sizes, and coverage areas across the image, posing challenges for most existing methods to effectively handle all cases. To address these challenges, this paper introduces a U-shaped Fast Fourier Transform Transformer and Hierarchical Transformer (F2T2-HiT) architecture, an innovative Transformer-based design for SIRR. Our approach uniquely combines Fast Fourier Transform (FFT) Transformer blocks and Hierarchical Transformer blocks within a UNet framework. The FFT Transformer blocks leverage the global frequency domain information to effectively capture and separate reflection patterns, while the Hierarchical Transformer blocks utilize multi-scale feature extraction to handle reflections of varying sizes and complexities. Extensive experiments conducted on three publicly available testing datasets demonstrate state-of-the-art performance, validating the effectiveness of our approach.
format Preprint
id arxiv_https___arxiv_org_abs_2506_05489
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle F2T2-HiT: A U-Shaped FFT Transformer and Hierarchical Transformer for Reflection Removal
Cai, Jie
Yang, Kangning
Ouyang, Ling
Fu, Lan
Ding, Jiaming
Sun, Huiming
Ho, Chiu Man
Meng, Zibo
Computer Vision and Pattern Recognition
Single Image Reflection Removal (SIRR) technique plays a crucial role in image processing by eliminating unwanted reflections from the background. These reflections, often caused by photographs taken through glass surfaces, can significantly degrade image quality. SIRR remains a challenging problem due to the complex and varied reflections encountered in real-world scenarios. These reflections vary significantly in intensity, shapes, light sources, sizes, and coverage areas across the image, posing challenges for most existing methods to effectively handle all cases. To address these challenges, this paper introduces a U-shaped Fast Fourier Transform Transformer and Hierarchical Transformer (F2T2-HiT) architecture, an innovative Transformer-based design for SIRR. Our approach uniquely combines Fast Fourier Transform (FFT) Transformer blocks and Hierarchical Transformer blocks within a UNet framework. The FFT Transformer blocks leverage the global frequency domain information to effectively capture and separate reflection patterns, while the Hierarchical Transformer blocks utilize multi-scale feature extraction to handle reflections of varying sizes and complexities. Extensive experiments conducted on three publicly available testing datasets demonstrate state-of-the-art performance, validating the effectiveness of our approach.
title F2T2-HiT: A U-Shaped FFT Transformer and Hierarchical Transformer for Reflection Removal
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.05489