FUMO: Prior-Modulated Diffusion for Single Image Reflection Removal

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Xu, Telang, Zhang, Chaoyang, Zhai, Guangtao, Liu, Xiaohong
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866918398313627648
author Xu, Telang
Zhang, Chaoyang
Zhai, Guangtao
Liu, Xiaohong
author_facet Xu, Telang
Zhang, Chaoyang
Zhai, Guangtao
Liu, Xiaohong
contents Single image reflection removal (SIRR) is challenging in real scenes, where reflection strength varies spatially and reflection patterns are tightly entangled with transmission structures. This paper presents a diffusion model with prior modulation framework (FUMO) that introduces explicit guidance signals to improve spatial controllability and structural faithfulness. Two priors are extracted directly from the mixed image, an intensity prior that estimates spatial reflection severity and a high-frequency prior that captures detail-sensitive responses via multi-scale residual aggregation. We propose a coarse-to-fine training paradigm. In the first stage, these cues are combined to gate the conditional residual injections, focusing the conditioning on regions that are both reflection-dominant and structure-sensitive. In the second stage, a fine-grained refinement network corrects local misalignment and sharpens fine details in the image space. Experiments conducted on both standard benchmarks and challenging images in the wild demonstrate competitive quantitative results and consistently improved perceptual quality. The code is released at https://github.com/Lucious-Desmon/FUMO.
format Preprint
id arxiv_https___arxiv_org_abs_2603_19036
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle FUMO: Prior-Modulated Diffusion for Single Image Reflection Removal
Xu, Telang
Zhang, Chaoyang
Zhai, Guangtao
Liu, Xiaohong
Computer Vision and Pattern Recognition
Single image reflection removal (SIRR) is challenging in real scenes, where reflection strength varies spatially and reflection patterns are tightly entangled with transmission structures. This paper presents a diffusion model with prior modulation framework (FUMO) that introduces explicit guidance signals to improve spatial controllability and structural faithfulness. Two priors are extracted directly from the mixed image, an intensity prior that estimates spatial reflection severity and a high-frequency prior that captures detail-sensitive responses via multi-scale residual aggregation. We propose a coarse-to-fine training paradigm. In the first stage, these cues are combined to gate the conditional residual injections, focusing the conditioning on regions that are both reflection-dominant and structure-sensitive. In the second stage, a fine-grained refinement network corrects local misalignment and sharpens fine details in the image space. Experiments conducted on both standard benchmarks and challenging images in the wild demonstrate competitive quantitative results and consistently improved perceptual quality. The code is released at https://github.com/Lucious-Desmon/FUMO.
title FUMO: Prior-Modulated Diffusion for Single Image Reflection Removal
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.19036