Polarization Uncertainty-Guided Diffusion Model for Color Polarization Image Demosaicking

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Li, Chenggong, Luo, Yidong, Zhang, Junchao, Yang, Degui
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914356579532800
author Li, Chenggong
Luo, Yidong
Zhang, Junchao
Yang, Degui
author_facet Li, Chenggong
Luo, Yidong
Zhang, Junchao
Yang, Degui
contents Color polarization demosaicking (CPDM) aims to reconstruct full-resolution polarization images of four directions from the color-polarization filter array (CPFA) raw image. Due to the challenge of predicting numerous missing pixels and the scarcity of high-quality training data, existing network-based methods, despite effectively recovering scene intensity information, still exhibit significant errors in reconstructing polarization characteristics (degree of polarization, DOP, and angle of polarization, AOP). To address this problem, we introduce the image diffusion prior from text-to-image (T2I) models to overcome the performance bottleneck of network-based methods, with the additional diffusion prior compensating for limited representational capacity caused by restricted data distribution. To effectively leverage the diffusion prior, we explicitly model the polarization uncertainty during reconstruction and use uncertainty to guide the diffusion model in recovering high error regions. Extensive experiments demonstrate that the proposed method accurately recovers scene polarization characteristics with both high fidelity and strong visual perception.
format Preprint
id arxiv_https___arxiv_org_abs_2602_23847
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Polarization Uncertainty-Guided Diffusion Model for Color Polarization Image Demosaicking
Li, Chenggong
Luo, Yidong
Zhang, Junchao
Yang, Degui
Image and Video Processing
Computer Vision and Pattern Recognition
Color polarization demosaicking (CPDM) aims to reconstruct full-resolution polarization images of four directions from the color-polarization filter array (CPFA) raw image. Due to the challenge of predicting numerous missing pixels and the scarcity of high-quality training data, existing network-based methods, despite effectively recovering scene intensity information, still exhibit significant errors in reconstructing polarization characteristics (degree of polarization, DOP, and angle of polarization, AOP). To address this problem, we introduce the image diffusion prior from text-to-image (T2I) models to overcome the performance bottleneck of network-based methods, with the additional diffusion prior compensating for limited representational capacity caused by restricted data distribution. To effectively leverage the diffusion prior, we explicitly model the polarization uncertainty during reconstruction and use uncertainty to guide the diffusion model in recovering high error regions. Extensive experiments demonstrate that the proposed method accurately recovers scene polarization characteristics with both high fidelity and strong visual perception.
title Polarization Uncertainty-Guided Diffusion Model for Color Polarization Image Demosaicking
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2602.23847