Efficient Neural Network Encoding for 3D Color Lookup Tables
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909435808448512 |
|---|---|
| author | Zehtab, Vahid Lindell, David B. Brubaker, Marcus A. Brown, Michael S. |
| author_facet | Zehtab, Vahid Lindell, David B. Brubaker, Marcus A. Brown, Michael S. |
| contents | 3D color lookup tables (LUTs) enable precise color manipulation by mapping input RGB values to specific output RGB values. 3D LUTs are instrumental in various applications, including video editing, in-camera processing, photographic filters, computer graphics, and color processing for displays. While an individual LUT does not incur a high memory overhead, software and devices may need to store dozens to hundreds of LUTs that can take over 100 MB. This work aims to develop a neural network architecture that can encode hundreds of LUTs in a single compact representation. To this end, we propose a model with a memory footprint of less than 0.25 MB that can reconstruct 512 LUTs with only minor color distortion ($\barΔE_M$ $\leq$ 2.0) over the entire color gamut. We also show that our network can weight colors to provide further quality gains on natural image colors ($\barΔ{E}_M$ $\leq$ 1.0). Finally, we show that minor modifications to the network architecture enable a bijective encoding that produces LUTs that are invertible, allowing for reverse color processing. Our code is available at https://github.com/vahidzee/ennelut. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_15438 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Efficient Neural Network Encoding for 3D Color Lookup Tables Zehtab, Vahid Lindell, David B. Brubaker, Marcus A. Brown, Michael S. Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning Image and Video Processing I.4.0; I.4.2; I.5.0; I.5.1; I.5.4; I.2.0; I.2.6; I.2.10 3D color lookup tables (LUTs) enable precise color manipulation by mapping input RGB values to specific output RGB values. 3D LUTs are instrumental in various applications, including video editing, in-camera processing, photographic filters, computer graphics, and color processing for displays. While an individual LUT does not incur a high memory overhead, software and devices may need to store dozens to hundreds of LUTs that can take over 100 MB. This work aims to develop a neural network architecture that can encode hundreds of LUTs in a single compact representation. To this end, we propose a model with a memory footprint of less than 0.25 MB that can reconstruct 512 LUTs with only minor color distortion ($\barΔE_M$ $\leq$ 2.0) over the entire color gamut. We also show that our network can weight colors to provide further quality gains on natural image colors ($\barΔ{E}_M$ $\leq$ 1.0). Finally, we show that minor modifications to the network architecture enable a bijective encoding that produces LUTs that are invertible, allowing for reverse color processing. Our code is available at https://github.com/vahidzee/ennelut. |
| title | Efficient Neural Network Encoding for 3D Color Lookup Tables |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning Image and Video Processing I.4.0; I.4.2; I.5.0; I.5.1; I.5.4; I.2.0; I.2.6; I.2.10 |
| url | https://arxiv.org/abs/2412.15438 |