Saved in:
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2401.02161 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911747516923904 |
|---|---|
| author | He, Xuanhua Hu, Tao Wang, Guoli Wang, Zejin Wang, Run Zhang, Qian Yan, Keyu Chen, Ziyi Li, Rui Xie, Chenjun Zhang, Jie Zhou, Man |
| author_facet | He, Xuanhua Hu, Tao Wang, Guoli Wang, Zejin Wang, Run Zhang, Qian Yan, Keyu Chen, Ziyi Li, Rui Xie, Chenjun Zhang, Jie Zhou, Man |
| contents | RAW to sRGB mapping, which aims to convert RAW images from smartphones into RGB form equivalent to that of Digital Single-Lens Reflex (DSLR) cameras, has become an important area of research. However, current methods often ignore the difference between cell phone RAW images and DSLR camera RGB images, a difference that goes beyond the color matrix and extends to spatial structure due to resolution variations. Recent methods directly rebuild color mapping and spatial structure via shared deep representation, limiting optimal performance. Inspired by Image Signal Processing (ISP) pipeline, which distinguishes image restoration and enhancement, we present a novel Neural ISP framework, named FourierISP. This approach breaks the image down into style and structure within the frequency domain, allowing for independent optimization. FourierISP is comprised of three subnetworks: Phase Enhance Subnet for structural refinement, Amplitude Refine Subnet for color learning, and Color Adaptation Subnet for blending them in a smooth manner. This approach sharpens both color and structure, and extensive evaluations across varied datasets confirm that our approach realizes state-of-the-art results. Code will be available at ~\url{https://github.com/alexhe101/FourierISP}. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_02161 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Enhancing RAW-to-sRGB with Decoupled Style Structure in Fourier Domain He, Xuanhua Hu, Tao Wang, Guoli Wang, Zejin Wang, Run Zhang, Qian Yan, Keyu Chen, Ziyi Li, Rui Xie, Chenjun Zhang, Jie Zhou, Man Computer Vision and Pattern Recognition RAW to sRGB mapping, which aims to convert RAW images from smartphones into RGB form equivalent to that of Digital Single-Lens Reflex (DSLR) cameras, has become an important area of research. However, current methods often ignore the difference between cell phone RAW images and DSLR camera RGB images, a difference that goes beyond the color matrix and extends to spatial structure due to resolution variations. Recent methods directly rebuild color mapping and spatial structure via shared deep representation, limiting optimal performance. Inspired by Image Signal Processing (ISP) pipeline, which distinguishes image restoration and enhancement, we present a novel Neural ISP framework, named FourierISP. This approach breaks the image down into style and structure within the frequency domain, allowing for independent optimization. FourierISP is comprised of three subnetworks: Phase Enhance Subnet for structural refinement, Amplitude Refine Subnet for color learning, and Color Adaptation Subnet for blending them in a smooth manner. This approach sharpens both color and structure, and extensive evaluations across varied datasets confirm that our approach realizes state-of-the-art results. Code will be available at ~\url{https://github.com/alexhe101/FourierISP}. |
| title | Enhancing RAW-to-sRGB with Decoupled Style Structure in Fourier Domain |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2401.02161 |