Exposure Bracketing Is All You Need For A High-Quality Image

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zhang, Zhilu, Zhang, Shuohao, Wu, Renlong, Yan, Zifei, Zuo, Wangmeng
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909464797380608
author Zhang, Zhilu
Zhang, Shuohao
Wu, Renlong
Yan, Zifei
Zuo, Wangmeng
author_facet Zhang, Zhilu
Zhang, Shuohao
Wu, Renlong
Yan, Zifei
Zuo, Wangmeng
contents It is highly desired but challenging to acquire high-quality photos with clear content in low-light environments. Although multi-image processing methods (using burst, dual-exposure, or multi-exposure images) have made significant progress in addressing this issue, they typically focus on specific restoration or enhancement problems, and do not fully explore the potential of utilizing multiple images. Motivated by the fact that multi-exposure images are complementary in denoising, deblurring, high dynamic range imaging, and super-resolution, we propose to utilize exposure bracketing photography to get a high-quality image by combining these tasks in this work. Due to the difficulty in collecting real-world pairs, we suggest a solution that first pre-trains the model with synthetic paired data and then adapts it to real-world unlabeled images. In particular, a temporally modulated recurrent network (TMRNet) and self-supervised adaptation method are proposed. Moreover, we construct a data simulation pipeline to synthesize pairs and collect real-world images from 200 nighttime scenarios. Experiments on both datasets show that our method performs favorably against the state-of-the-art multi-image processing ones. Code and datasets are available at https://github.com/cszhilu1998/BracketIRE.
format Preprint
id arxiv_https___arxiv_org_abs_2401_00766
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Exposure Bracketing Is All You Need For A High-Quality Image
Zhang, Zhilu
Zhang, Shuohao
Wu, Renlong
Yan, Zifei
Zuo, Wangmeng
Computer Vision and Pattern Recognition
Image and Video Processing
It is highly desired but challenging to acquire high-quality photos with clear content in low-light environments. Although multi-image processing methods (using burst, dual-exposure, or multi-exposure images) have made significant progress in addressing this issue, they typically focus on specific restoration or enhancement problems, and do not fully explore the potential of utilizing multiple images. Motivated by the fact that multi-exposure images are complementary in denoising, deblurring, high dynamic range imaging, and super-resolution, we propose to utilize exposure bracketing photography to get a high-quality image by combining these tasks in this work. Due to the difficulty in collecting real-world pairs, we suggest a solution that first pre-trains the model with synthetic paired data and then adapts it to real-world unlabeled images. In particular, a temporally modulated recurrent network (TMRNet) and self-supervised adaptation method are proposed. Moreover, we construct a data simulation pipeline to synthesize pairs and collect real-world images from 200 nighttime scenarios. Experiments on both datasets show that our method performs favorably against the state-of-the-art multi-image processing ones. Code and datasets are available at https://github.com/cszhilu1998/BracketIRE.
title Exposure Bracketing Is All You Need For A High-Quality Image
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2401.00766