3D Gaussian Inverse Rendering with Approximated Global Illumination

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wu, Zirui, Chen, Jianteng, Li, Laijian, Wu, Shaoteng, Zhu, Zhikai, Xu, Kang, Oswald, Martin R., Song, Jie
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909561278955520
author Wu, Zirui
Chen, Jianteng
Li, Laijian
Wu, Shaoteng
Zhu, Zhikai
Xu, Kang
Oswald, Martin R.
Song, Jie
author_facet Wu, Zirui
Chen, Jianteng
Li, Laijian
Wu, Shaoteng
Zhu, Zhikai
Xu, Kang
Oswald, Martin R.
Song, Jie
contents 3D Gaussian Splatting shows great potential in reconstructing photo-realistic 3D scenes. However, these methods typically bake illumination into their representations, limiting their use for physically-based rendering and scene editing. Although recent inverse rendering approaches aim to decompose scenes into material and lighting components, they often rely on simplifying assumptions that fail when editing. We present a novel approach that enables efficient global illumination for 3D Gaussians Splatting through screen-space ray tracing. Our key insight is that a substantial amount of indirect light can be traced back to surfaces visible within the current view frustum. Leveraging this observation, we augment the direct shading computed by 3D Gaussians with Monte-Carlo screen-space ray-tracing to capture one-bounce indirect illumination. In this way, our method enables realistic global illumination without sacrificing the computational efficiency and editability benefits of 3D Gaussians. Through experiments, we show that the screen-space approximation we utilize allows for indirect illumination and supports real-time rendering and editing. Code, data, and models will be made available at our project page: https://wuzirui.github.io/gs-ssr.
format Preprint
id arxiv_https___arxiv_org_abs_2504_01358
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle 3D Gaussian Inverse Rendering with Approximated Global Illumination
Wu, Zirui
Chen, Jianteng
Li, Laijian
Wu, Shaoteng
Zhu, Zhikai
Xu, Kang
Oswald, Martin R.
Song, Jie
Graphics
Computer Vision and Pattern Recognition
3D Gaussian Splatting shows great potential in reconstructing photo-realistic 3D scenes. However, these methods typically bake illumination into their representations, limiting their use for physically-based rendering and scene editing. Although recent inverse rendering approaches aim to decompose scenes into material and lighting components, they often rely on simplifying assumptions that fail when editing. We present a novel approach that enables efficient global illumination for 3D Gaussians Splatting through screen-space ray tracing. Our key insight is that a substantial amount of indirect light can be traced back to surfaces visible within the current view frustum. Leveraging this observation, we augment the direct shading computed by 3D Gaussians with Monte-Carlo screen-space ray-tracing to capture one-bounce indirect illumination. In this way, our method enables realistic global illumination without sacrificing the computational efficiency and editability benefits of 3D Gaussians. Through experiments, we show that the screen-space approximation we utilize allows for indirect illumination and supports real-time rendering and editing. Code, data, and models will be made available at our project page: https://wuzirui.github.io/gs-ssr.
title 3D Gaussian Inverse Rendering with Approximated Global Illumination
topic Graphics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.01358