Improving the color accuracy of lighting estimation models

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zhang, Zitian, Davis, Joshua Urban, Vu, Jeanne Phuong Anh, Kuang, Jiangtao, Lalonde, Jean-François
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866918146259025920
author Zhang, Zitian
Davis, Joshua Urban
Vu, Jeanne Phuong Anh
Kuang, Jiangtao
Lalonde, Jean-François
author_facet Zhang, Zitian
Davis, Joshua Urban
Vu, Jeanne Phuong Anh
Kuang, Jiangtao
Lalonde, Jean-François
contents Advances in high dynamic range (HDR) lighting estimation from a single image have opened new possibilities for augmented reality (AR) applications. Predicting complex lighting environments from a single input image allows for the realistic rendering and compositing of virtual objects. In this work, we investigate the color robustness of such methods -- an often overlooked yet critical factor for achieving visual realism. While most evaluations conflate color with other lighting attributes (e.g., intensity, direction), we isolate color as the primary variable of interest. Rather than introducing a new lighting estimation algorithm, we explore whether simple adaptation techniques can enhance the color accuracy of existing models. Using a novel HDR dataset featuring diverse lighting colors, we systematically evaluate several adaptation strategies. Our results show that preprocessing the input image with a pre-trained white balance network improves color robustness, outperforming other strategies across all tested scenarios. Notably, this approach requires no retraining of the lighting estimation model. We further validate the generality of this finding by applying the technique to three state-of-the-art lighting estimation methods from recent literature.
format Preprint
id arxiv_https___arxiv_org_abs_2509_18390
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Improving the color accuracy of lighting estimation models
Zhang, Zitian
Davis, Joshua Urban
Vu, Jeanne Phuong Anh
Kuang, Jiangtao
Lalonde, Jean-François
Computer Vision and Pattern Recognition
Advances in high dynamic range (HDR) lighting estimation from a single image have opened new possibilities for augmented reality (AR) applications. Predicting complex lighting environments from a single input image allows for the realistic rendering and compositing of virtual objects. In this work, we investigate the color robustness of such methods -- an often overlooked yet critical factor for achieving visual realism. While most evaluations conflate color with other lighting attributes (e.g., intensity, direction), we isolate color as the primary variable of interest. Rather than introducing a new lighting estimation algorithm, we explore whether simple adaptation techniques can enhance the color accuracy of existing models. Using a novel HDR dataset featuring diverse lighting colors, we systematically evaluate several adaptation strategies. Our results show that preprocessing the input image with a pre-trained white balance network improves color robustness, outperforming other strategies across all tested scenarios. Notably, this approach requires no retraining of the lighting estimation model. We further validate the generality of this finding by applying the technique to three state-of-the-art lighting estimation methods from recent literature.
title Improving the color accuracy of lighting estimation models
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2509.18390