CAPformer: Compression-Aware Pre-trained Transformer for Low-Light Image Enhancement

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wang, Wei, Jin, Zhi
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916318146461696
author Wang, Wei
Jin, Zhi
author_facet Wang, Wei
Jin, Zhi
contents Low-Light Image Enhancement (LLIE) has advanced with the surge in phone photography demand, yet many existing methods neglect compression, a crucial concern for resource-constrained phone photography. Most LLIE methods overlook this, hindering their effectiveness. In this study, we investigate the effects of JPEG compression on low-light images and reveal substantial information loss caused by JPEG due to widespread low pixel values in dark areas. Hence, we propose the Compression-Aware Pre-trained Transformer (CAPformer), employing a novel pre-training strategy to learn lossless information from uncompressed low-light images. Additionally, the proposed Brightness-Guided Self-Attention (BGSA) mechanism enhances rational information gathering. Experiments demonstrate the superiority of our approach in mitigating compression effects on LLIE, showcasing its potential for improving LLIE in resource-constrained scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2407_07056
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle CAPformer: Compression-Aware Pre-trained Transformer for Low-Light Image Enhancement
Wang, Wei
Jin, Zhi
Computer Vision and Pattern Recognition
Image and Video Processing
Low-Light Image Enhancement (LLIE) has advanced with the surge in phone photography demand, yet many existing methods neglect compression, a crucial concern for resource-constrained phone photography. Most LLIE methods overlook this, hindering their effectiveness. In this study, we investigate the effects of JPEG compression on low-light images and reveal substantial information loss caused by JPEG due to widespread low pixel values in dark areas. Hence, we propose the Compression-Aware Pre-trained Transformer (CAPformer), employing a novel pre-training strategy to learn lossless information from uncompressed low-light images. Additionally, the proposed Brightness-Guided Self-Attention (BGSA) mechanism enhances rational information gathering. Experiments demonstrate the superiority of our approach in mitigating compression effects on LLIE, showcasing its potential for improving LLIE in resource-constrained scenarios.
title CAPformer: Compression-Aware Pre-trained Transformer for Low-Light Image Enhancement
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2407.07056