Colorizing Monochromatic Radiance Fields

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Cheng, Yean, Wan, Renjie, Weng, Shuchen, Zhu, Chengxuan, Chang, Yakun, Shi, Boxin
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911779666264064
author Cheng, Yean
Wan, Renjie
Weng, Shuchen
Zhu, Chengxuan
Chang, Yakun
Shi, Boxin
author_facet Cheng, Yean
Wan, Renjie
Weng, Shuchen
Zhu, Chengxuan
Chang, Yakun
Shi, Boxin
contents Though Neural Radiance Fields (NeRF) can produce colorful 3D representations of the world by using a set of 2D images, such ability becomes non-existent when only monochromatic images are provided. Since color is necessary in representing the world, reproducing color from monochromatic radiance fields becomes crucial. To achieve this goal, instead of manipulating the monochromatic radiance fields directly, we consider it as a representation-prediction task in the Lab color space. By first constructing the luminance and density representation using monochromatic images, our prediction stage can recreate color representation on the basis of an image colorization module. We then reproduce a colorful implicit model through the representation of luminance, density, and color. Extensive experiments have been conducted to validate the effectiveness of our approaches. Our project page: https://liquidammonia.github.io/color-nerf.
format Preprint
id arxiv_https___arxiv_org_abs_2402_12184
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Colorizing Monochromatic Radiance Fields
Cheng, Yean
Wan, Renjie
Weng, Shuchen
Zhu, Chengxuan
Chang, Yakun
Shi, Boxin
Computer Vision and Pattern Recognition
Though Neural Radiance Fields (NeRF) can produce colorful 3D representations of the world by using a set of 2D images, such ability becomes non-existent when only monochromatic images are provided. Since color is necessary in representing the world, reproducing color from monochromatic radiance fields becomes crucial. To achieve this goal, instead of manipulating the monochromatic radiance fields directly, we consider it as a representation-prediction task in the Lab color space. By first constructing the luminance and density representation using monochromatic images, our prediction stage can recreate color representation on the basis of an image colorization module. We then reproduce a colorful implicit model through the representation of luminance, density, and color. Extensive experiments have been conducted to validate the effectiveness of our approaches. Our project page: https://liquidammonia.github.io/color-nerf.
title Colorizing Monochromatic Radiance Fields
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2402.12184