Learning Latent Transmission and Glare Maps for Lens Veiling Glare Removal

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Qian, Xiaolong, Jiang, Qi, Sun, Lei, Yu, Zongxi, Yang, Kailun, Wu, Peixuan, Zhou, Jiacheng, Gao, Yao, Ma, Yaoguang, Yang, Ming-Hsuan, Wang, Kaiwei
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908869843746816
author Qian, Xiaolong
Jiang, Qi
Sun, Lei
Yu, Zongxi
Yang, Kailun
Wu, Peixuan
Zhou, Jiacheng
Gao, Yao
Ma, Yaoguang
Yang, Ming-Hsuan
Wang, Kaiwei
author_facet Qian, Xiaolong
Jiang, Qi
Sun, Lei
Yu, Zongxi
Yang, Kailun
Wu, Peixuan
Zhou, Jiacheng
Gao, Yao
Ma, Yaoguang
Yang, Ming-Hsuan
Wang, Kaiwei
contents Beyond the commonly recognized optical aberrations, the imaging performance of simplified optical systems--including single-lens and metalens designs--is often further degraded by veiling glare caused by stray-light scattering from non-ideal optical surfaces and coatings, particularly in complex real-world environments. This compound degradation undermines traditional lens aberration correction yet remains underexplored. A major challenge is that conventional scattering models (e.g., for dehazing) fail to fit veiling glare due to its spatial-varying and depth-independent nature. Consequently, paired high-quality data are difficult to prepare via simulation, hindering application of data-driven veiling glare removal models. To this end, we propose VeilGen, a generative model that learns to simulate veiling glare by estimating its underlying optical transmission and glare maps in an unsupervised manner from target images, regularized by Stable Diffusion (SD)-based priors. VeilGen enables paired dataset generation with realistic compound degradation of optical aberrations and veiling glare, while also providing the estimated latent optical transmission and glare maps to guide the veiling glare removal process. We further introduce DeVeiler, a restoration network trained with a reversibility constraint, which utilizes the predicted latent maps to guide an inverse process of the learned scattering model. Extensive experiments on challenging simplified optical systems demonstrate that our approach delivers superior restoration quality and physical fidelity compared with existing methods. These suggest that VeilGen reliably synthesizes realistic veiling glare, and its learned latent maps effectively guide the restoration process in DeVeiler. All code and datasets will be publicly released at https://github.com/XiaolongQian/DeVeiler.
format Preprint
id arxiv_https___arxiv_org_abs_2511_17353
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Learning Latent Transmission and Glare Maps for Lens Veiling Glare Removal
Qian, Xiaolong
Jiang, Qi
Sun, Lei
Yu, Zongxi
Yang, Kailun
Wu, Peixuan
Zhou, Jiacheng
Gao, Yao
Ma, Yaoguang
Yang, Ming-Hsuan
Wang, Kaiwei
Image and Video Processing
Computer Vision and Pattern Recognition
Optics
Beyond the commonly recognized optical aberrations, the imaging performance of simplified optical systems--including single-lens and metalens designs--is often further degraded by veiling glare caused by stray-light scattering from non-ideal optical surfaces and coatings, particularly in complex real-world environments. This compound degradation undermines traditional lens aberration correction yet remains underexplored. A major challenge is that conventional scattering models (e.g., for dehazing) fail to fit veiling glare due to its spatial-varying and depth-independent nature. Consequently, paired high-quality data are difficult to prepare via simulation, hindering application of data-driven veiling glare removal models. To this end, we propose VeilGen, a generative model that learns to simulate veiling glare by estimating its underlying optical transmission and glare maps in an unsupervised manner from target images, regularized by Stable Diffusion (SD)-based priors. VeilGen enables paired dataset generation with realistic compound degradation of optical aberrations and veiling glare, while also providing the estimated latent optical transmission and glare maps to guide the veiling glare removal process. We further introduce DeVeiler, a restoration network trained with a reversibility constraint, which utilizes the predicted latent maps to guide an inverse process of the learned scattering model. Extensive experiments on challenging simplified optical systems demonstrate that our approach delivers superior restoration quality and physical fidelity compared with existing methods. These suggest that VeilGen reliably synthesizes realistic veiling glare, and its learned latent maps effectively guide the restoration process in DeVeiler. All code and datasets will be publicly released at https://github.com/XiaolongQian/DeVeiler.
title Learning Latent Transmission and Glare Maps for Lens Veiling Glare Removal
topic Image and Video Processing
Computer Vision and Pattern Recognition
Optics
url https://arxiv.org/abs/2511.17353