Exploring Spectral Characteristics for Single Image Reflection Removal

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Guo, Pengbo, Liu, Chengxu, Zhao, Guoshuai, Hou, Xingsong, Shen, Jialie, Qian, Xueming
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914039182917632
author Guo, Pengbo
Liu, Chengxu
Zhao, Guoshuai
Hou, Xingsong
Shen, Jialie
Qian, Xueming
author_facet Guo, Pengbo
Liu, Chengxu
Zhao, Guoshuai
Hou, Xingsong
Shen, Jialie
Qian, Xueming
contents Eliminating reflections caused by incident light interacting with reflective medium remains an ill-posed problem in the image restoration area. The primary challenge arises from the overlapping of reflection and transmission components in the captured images, which complicates the task of accurately distinguishing and recovering the clean background. Existing approaches typically address reflection removal solely in the image domain, ignoring the spectral property variations of reflected light, which hinders their ability to effectively discern reflections. In this paper, we start with a new perspective on spectral learning, and propose the Spectral Codebook to reconstruct the optical spectrum of the reflection image. The reflections can be effectively distinguished by perceiving the wavelength differences between different light sources in the spectrum. To leverage the reconstructed spectrum, we design two spectral prior refinement modules to re-distribute pixels in the spatial dimension and adaptively enhance the spectral differences along the wavelength dimension. Furthermore, we present the Spectrum-Aware Transformer to jointly recover the transmitted content in spectral and pixel domains. Experimental results on three different reflection benchmarks demonstrate the superiority and generalization ability of our method compared to state-of-the-art models.
format Preprint
id arxiv_https___arxiv_org_abs_2509_12627
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Exploring Spectral Characteristics for Single Image Reflection Removal
Guo, Pengbo
Liu, Chengxu
Zhao, Guoshuai
Hou, Xingsong
Shen, Jialie
Qian, Xueming
Computer Vision and Pattern Recognition
Eliminating reflections caused by incident light interacting with reflective medium remains an ill-posed problem in the image restoration area. The primary challenge arises from the overlapping of reflection and transmission components in the captured images, which complicates the task of accurately distinguishing and recovering the clean background. Existing approaches typically address reflection removal solely in the image domain, ignoring the spectral property variations of reflected light, which hinders their ability to effectively discern reflections. In this paper, we start with a new perspective on spectral learning, and propose the Spectral Codebook to reconstruct the optical spectrum of the reflection image. The reflections can be effectively distinguished by perceiving the wavelength differences between different light sources in the spectrum. To leverage the reconstructed spectrum, we design two spectral prior refinement modules to re-distribute pixels in the spatial dimension and adaptively enhance the spectral differences along the wavelength dimension. Furthermore, we present the Spectrum-Aware Transformer to jointly recover the transmitted content in spectral and pixel domains. Experimental results on three different reflection benchmarks demonstrate the superiority and generalization ability of our method compared to state-of-the-art models.
title Exploring Spectral Characteristics for Single Image Reflection Removal
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2509.12627