RGS-DR: Deferred Reflections and Residual Shading in 2D Gaussian Splatting

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kouros, Georgios, Wu, Minye, Tuytelaars, Tinne
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908700842655744
author Kouros, Georgios
Wu, Minye
Tuytelaars, Tinne
author_facet Kouros, Georgios
Wu, Minye
Tuytelaars, Tinne
contents In this work, we address specular appearance in inverse rendering using 2D Gaussian splatting with deferred shading and argue for a refinement stage to improve specular detail, thereby bridging the gap with reconstruction-only methods. Our pipeline estimates editable material properties and environment illumination while employing a directional residual pass that captures leftover view-dependent effects for further refining novel view synthesis. In contrast to per-Gaussian shading with shortest-axis normals and normal residuals, which tends to result in more noisy geometry and specular appearance, a pixel-deferred surfel formulation with specular residuals yields sharper highlights, cleaner materials, and improved editability. We evaluate our approach on rendering and reconstruction quality on three popular datasets featuring glossy objects, and also demonstrate high-quality relighting and material editing.
format Preprint
id arxiv_https___arxiv_org_abs_2504_18468
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle RGS-DR: Deferred Reflections and Residual Shading in 2D Gaussian Splatting
Kouros, Georgios
Wu, Minye
Tuytelaars, Tinne
Computer Vision and Pattern Recognition
In this work, we address specular appearance in inverse rendering using 2D Gaussian splatting with deferred shading and argue for a refinement stage to improve specular detail, thereby bridging the gap with reconstruction-only methods. Our pipeline estimates editable material properties and environment illumination while employing a directional residual pass that captures leftover view-dependent effects for further refining novel view synthesis. In contrast to per-Gaussian shading with shortest-axis normals and normal residuals, which tends to result in more noisy geometry and specular appearance, a pixel-deferred surfel formulation with specular residuals yields sharper highlights, cleaner materials, and improved editability. We evaluate our approach on rendering and reconstruction quality on three popular datasets featuring glossy objects, and also demonstrate high-quality relighting and material editing.
title RGS-DR: Deferred Reflections and Residual Shading in 2D Gaussian Splatting
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.18468