Fast High Dynamic Range Radiance Fields for Dynamic Scenes

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wu, Guanjun, Yi, Taoran, Fang, Jiemin, Liu, Wenyu, Wang, Xinggang
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916088633098240
author Wu, Guanjun
Yi, Taoran
Fang, Jiemin
Liu, Wenyu
Wang, Xinggang
author_facet Wu, Guanjun
Yi, Taoran
Fang, Jiemin
Liu, Wenyu
Wang, Xinggang
contents Neural Radiances Fields (NeRF) and their extensions have shown great success in representing 3D scenes and synthesizing novel-view images. However, most NeRF methods take in low-dynamic-range (LDR) images, which may lose details, especially with nonuniform illumination. Some previous NeRF methods attempt to introduce high-dynamic-range (HDR) techniques but mainly target static scenes. To extend HDR NeRF methods to wider applications, we propose a dynamic HDR NeRF framework, named HDR-HexPlane, which can learn 3D scenes from dynamic 2D images captured with various exposures. A learnable exposure mapping function is constructed to obtain adaptive exposure values for each image. Based on the monotonically increasing prior, a camera response function is designed for stable learning. With the proposed model, high-quality novel-view images at any time point can be rendered with any desired exposure. We further construct a dataset containing multiple dynamic scenes captured with diverse exposures for evaluation. All the datasets and code are available at \url{https://guanjunwu.github.io/HDR-HexPlane/}.
format Preprint
id arxiv_https___arxiv_org_abs_2401_06052
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Fast High Dynamic Range Radiance Fields for Dynamic Scenes
Wu, Guanjun
Yi, Taoran
Fang, Jiemin
Liu, Wenyu
Wang, Xinggang
Computer Vision and Pattern Recognition
Graphics
Neural Radiances Fields (NeRF) and their extensions have shown great success in representing 3D scenes and synthesizing novel-view images. However, most NeRF methods take in low-dynamic-range (LDR) images, which may lose details, especially with nonuniform illumination. Some previous NeRF methods attempt to introduce high-dynamic-range (HDR) techniques but mainly target static scenes. To extend HDR NeRF methods to wider applications, we propose a dynamic HDR NeRF framework, named HDR-HexPlane, which can learn 3D scenes from dynamic 2D images captured with various exposures. A learnable exposure mapping function is constructed to obtain adaptive exposure values for each image. Based on the monotonically increasing prior, a camera response function is designed for stable learning. With the proposed model, high-quality novel-view images at any time point can be rendered with any desired exposure. We further construct a dataset containing multiple dynamic scenes captured with diverse exposures for evaluation. All the datasets and code are available at \url{https://guanjunwu.github.io/HDR-HexPlane/}.
title Fast High Dynamic Range Radiance Fields for Dynamic Scenes
topic Computer Vision and Pattern Recognition
Graphics
url https://arxiv.org/abs/2401.06052