Lightweight Gradient-Aware Upscaling of 3D Gaussian Splatting Images

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Niedermayr, Simon, Westermann, Christoph Neuhauser Rüdiger
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914041989955584
author Niedermayr, Simon
Westermann, Christoph Neuhauser Rüdiger
author_facet Niedermayr, Simon
Westermann, Christoph Neuhauser Rüdiger
contents We introduce an image upscaling technique tailored for 3D Gaussian Splatting (3DGS) on lightweight GPUs. Compared to 3DGS, it achieves significantly higher rendering speeds and reduces artifacts commonly observed in 3DGS reconstructions. Our technique upscales low-resolution 3DGS renderings with a marginal increase in cost by directly leveraging the analytical image gradients of Gaussians for gradient-based bicubic spline interpolation. The technique is agnostic to the specific 3DGS implementation, achieving novel view synthesis at rates 3x-4x higher than the baseline implementation. Through extensive experiments on multiple datasets, we showcase the performance improvements and high reconstruction fidelity attainable with gradient-aware upscaling of 3DGS images. We further demonstrate the integration of gradient-aware upscaling into the gradient-based optimization of a 3DGS model and analyze its effects on reconstruction quality and performance.
format Preprint
id arxiv_https___arxiv_org_abs_2503_14171
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Lightweight Gradient-Aware Upscaling of 3D Gaussian Splatting Images
Niedermayr, Simon
Westermann, Christoph Neuhauser Rüdiger
Computer Vision and Pattern Recognition
Image and Video Processing
We introduce an image upscaling technique tailored for 3D Gaussian Splatting (3DGS) on lightweight GPUs. Compared to 3DGS, it achieves significantly higher rendering speeds and reduces artifacts commonly observed in 3DGS reconstructions. Our technique upscales low-resolution 3DGS renderings with a marginal increase in cost by directly leveraging the analytical image gradients of Gaussians for gradient-based bicubic spline interpolation. The technique is agnostic to the specific 3DGS implementation, achieving novel view synthesis at rates 3x-4x higher than the baseline implementation. Through extensive experiments on multiple datasets, we showcase the performance improvements and high reconstruction fidelity attainable with gradient-aware upscaling of 3DGS images. We further demonstrate the integration of gradient-aware upscaling into the gradient-based optimization of a 3DGS model and analyze its effects on reconstruction quality and performance.
title Lightweight Gradient-Aware Upscaling of 3D Gaussian Splatting Images
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2503.14171