CCMNet: Leveraging Calibrated Color Correction Matrices for Cross-Camera Color Constancy

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Kim, Dongyoung, Afifi, Mahmoud, Kim, Dongyun, Brown, Michael S., Kim, Seon Joo
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909963563040768
author Kim, Dongyoung
Afifi, Mahmoud
Kim, Dongyun
Brown, Michael S.
Kim, Seon Joo
author_facet Kim, Dongyoung
Afifi, Mahmoud
Kim, Dongyun
Brown, Michael S.
Kim, Seon Joo
contents Computational color constancy, or white balancing, is a key module in a camera's image signal processor (ISP) that corrects color casts from scene lighting. Because this operation occurs in the camera-specific raw color space, white balance algorithms must adapt to different cameras. This paper introduces a learning-based method for cross-camera color constancy that generalizes to new cameras without retraining. Our method leverages pre-calibrated color correction matrices (CCMs) available on ISPs that map the camera's raw color space to a standard space (e.g., CIE XYZ). Our method uses these CCMs to transform predefined illumination colors (i.e., along the Planckian locus) into the test camera's raw space. The mapped illuminants are encoded into a compact camera fingerprint embedding (CFE) that enables the network to adapt to unseen cameras. To prevent overfitting due to limited cameras and CCMs during training, we introduce a data augmentation technique that interpolates between cameras and their CCMs. Experimental results across multiple datasets and backbones show that our method achieves state-of-the-art cross-camera color constancy while remaining lightweight and relying only on data readily available in camera ISPs.
format Preprint
id arxiv_https___arxiv_org_abs_2504_07959
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle CCMNet: Leveraging Calibrated Color Correction Matrices for Cross-Camera Color Constancy
Kim, Dongyoung
Afifi, Mahmoud
Kim, Dongyun
Brown, Michael S.
Kim, Seon Joo
Computer Vision and Pattern Recognition
Computational color constancy, or white balancing, is a key module in a camera's image signal processor (ISP) that corrects color casts from scene lighting. Because this operation occurs in the camera-specific raw color space, white balance algorithms must adapt to different cameras. This paper introduces a learning-based method for cross-camera color constancy that generalizes to new cameras without retraining. Our method leverages pre-calibrated color correction matrices (CCMs) available on ISPs that map the camera's raw color space to a standard space (e.g., CIE XYZ). Our method uses these CCMs to transform predefined illumination colors (i.e., along the Planckian locus) into the test camera's raw space. The mapped illuminants are encoded into a compact camera fingerprint embedding (CFE) that enables the network to adapt to unseen cameras. To prevent overfitting due to limited cameras and CCMs during training, we introduce a data augmentation technique that interpolates between cameras and their CCMs. Experimental results across multiple datasets and backbones show that our method achieves state-of-the-art cross-camera color constancy while remaining lightweight and relying only on data readily available in camera ISPs.
title CCMNet: Leveraging Calibrated Color Correction Matrices for Cross-Camera Color Constancy
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.07959