Saved in:
Bibliographic Details
Main Authors: Wang, Hongsheng, Wang, Yang, Liu, Yalan, Hu, Fayuan, Zhang, Shengyu, Wu, Fei, Lin, Feng
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2405.13097
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929352140128256
author Wang, Hongsheng
Wang, Yang
Liu, Yalan
Hu, Fayuan
Zhang, Shengyu
Wu, Fei
Lin, Feng
author_facet Wang, Hongsheng
Wang, Yang
Liu, Yalan
Hu, Fayuan
Zhang, Shengyu
Wu, Fei
Lin, Feng
contents In real-world road scenes, diverse material properties lead to complex light reflection phenomena, making accurate color reproduction crucial for enhancing the realism and safety of simulated driving environments. However, existing methods often struggle to capture the full spectrum of lighting effects, particularly in dynamic scenarios where viewpoint changes induce significant material color variations. To address this challenge, we introduce NieR (Normal-Based Lighting Scene Rendering), a novel framework that takes into account the nuances of light reflection on diverse material surfaces, leading to more precise rendering. To simulate the lighting synthesis process, we present the LD (Light Decomposition) module, which captures the lighting reflection characteristics on surfaces. Furthermore, to address dynamic lighting scenes, we propose the HNGD (Hierarchical Normal Gradient Densification) module to overcome the limitations of sparse Gaussian representation. Specifically, we dynamically adjust the Gaussian density based on normal gradients. Experimental evaluations demonstrate that our method outperforms state-of-the-art (SOTA) methods in terms of visual quality and exhibits significant advantages in performance indicators. Codes are available at https://wanghongsheng01.github.io/NieR/.
format Preprint
id arxiv_https___arxiv_org_abs_2405_13097
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle NieR: Normal-Based Lighting Scene Rendering
Wang, Hongsheng
Wang, Yang
Liu, Yalan
Hu, Fayuan
Zhang, Shengyu
Wu, Fei
Lin, Feng
Computer Vision and Pattern Recognition
In real-world road scenes, diverse material properties lead to complex light reflection phenomena, making accurate color reproduction crucial for enhancing the realism and safety of simulated driving environments. However, existing methods often struggle to capture the full spectrum of lighting effects, particularly in dynamic scenarios where viewpoint changes induce significant material color variations. To address this challenge, we introduce NieR (Normal-Based Lighting Scene Rendering), a novel framework that takes into account the nuances of light reflection on diverse material surfaces, leading to more precise rendering. To simulate the lighting synthesis process, we present the LD (Light Decomposition) module, which captures the lighting reflection characteristics on surfaces. Furthermore, to address dynamic lighting scenes, we propose the HNGD (Hierarchical Normal Gradient Densification) module to overcome the limitations of sparse Gaussian representation. Specifically, we dynamically adjust the Gaussian density based on normal gradients. Experimental evaluations demonstrate that our method outperforms state-of-the-art (SOTA) methods in terms of visual quality and exhibits significant advantages in performance indicators. Codes are available at https://wanghongsheng01.github.io/NieR/.
title NieR: Normal-Based Lighting Scene Rendering
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2405.13097