Low-Light Image Enhancement using Event-Based Illumination Estimation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Sun, Lei, Bao, Yuhan, Zhai, Jiajun, Liang, Jingyun, Zhang, Yulun, Wang, Kaiwei, Paudel, Danda Pani, Van Gool, Luc
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912324770594816
author Sun, Lei
Bao, Yuhan
Zhai, Jiajun
Liang, Jingyun
Zhang, Yulun
Wang, Kaiwei
Paudel, Danda Pani
Van Gool, Luc
author_facet Sun, Lei
Bao, Yuhan
Zhai, Jiajun
Liang, Jingyun
Zhang, Yulun
Wang, Kaiwei
Paudel, Danda Pani
Van Gool, Luc
contents Low-light image enhancement (LLIE) aims to improve the visibility of images captured in poorly lit environments. Prevalent event-based solutions primarily utilize events triggered by motion, i.e., ''motion events'' to strengthen only the edge texture, while leaving the high dynamic range and excellent low-light responsiveness of event cameras largely unexplored. This paper instead opens a new avenue from the perspective of estimating the illumination using ''temporal-mapping'' events, i.e., by converting the timestamps of events triggered by a transmittance modulation into brightness values. The resulting fine-grained illumination cues facilitate a more effective decomposition and enhancement of the reflectance component in low-light images through the proposed Illumination-aided Reflectance Enhancement module. Furthermore, the degradation model of temporal-mapping events under low-light condition is investigated for realistic training data synthesizing. To address the lack of datasets under this regime, we construct a beam-splitter setup and collect EvLowLight dataset that includes images, temporal-mapping events, and motion events. Extensive experiments across 5 synthetic datasets and our real-world EvLowLight dataset substantiate that the devised pipeline, dubbed RetinEV, excels in producing well-illuminated, high dynamic range images, outperforming previous state-of-the-art event-based methods by up to 6.62 dB, while maintaining an efficient inference speed of 35.6 frame-per-second on a 640X480 image.
format Preprint
id arxiv_https___arxiv_org_abs_2504_09379
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Low-Light Image Enhancement using Event-Based Illumination Estimation
Sun, Lei
Bao, Yuhan
Zhai, Jiajun
Liang, Jingyun
Zhang, Yulun
Wang, Kaiwei
Paudel, Danda Pani
Van Gool, Luc
Computer Vision and Pattern Recognition
Low-light image enhancement (LLIE) aims to improve the visibility of images captured in poorly lit environments. Prevalent event-based solutions primarily utilize events triggered by motion, i.e., ''motion events'' to strengthen only the edge texture, while leaving the high dynamic range and excellent low-light responsiveness of event cameras largely unexplored. This paper instead opens a new avenue from the perspective of estimating the illumination using ''temporal-mapping'' events, i.e., by converting the timestamps of events triggered by a transmittance modulation into brightness values. The resulting fine-grained illumination cues facilitate a more effective decomposition and enhancement of the reflectance component in low-light images through the proposed Illumination-aided Reflectance Enhancement module. Furthermore, the degradation model of temporal-mapping events under low-light condition is investigated for realistic training data synthesizing. To address the lack of datasets under this regime, we construct a beam-splitter setup and collect EvLowLight dataset that includes images, temporal-mapping events, and motion events. Extensive experiments across 5 synthetic datasets and our real-world EvLowLight dataset substantiate that the devised pipeline, dubbed RetinEV, excels in producing well-illuminated, high dynamic range images, outperforming previous state-of-the-art event-based methods by up to 6.62 dB, while maintaining an efficient inference speed of 35.6 frame-per-second on a 640X480 image.
title Low-Light Image Enhancement using Event-Based Illumination Estimation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.09379