Instant Colorization of Gaussian Splats

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Lieber, Daniel, Mock, Alexander, Wandel, Nils
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917418292477952
author Lieber, Daniel
Mock, Alexander
Wandel, Nils
author_facet Lieber, Daniel
Mock, Alexander
Wandel, Nils
contents Gaussian Splatting has recently become one of the most popular frameworks for photorealistic 3D scene reconstruction and rendering. While current rasterizers allow for efficient mappings of 3D Gaussian splats onto 2D camera views, this work focuses on mapping 2D image information (e.g. color, neural features or segmentation masks) efficiently back onto an existing scene of Gaussian splats. This 'opposite' direction enables applications ranging from scene relighting and stylization to 3D semantic segmentation, but also introduces challenges, such as view-dependent colorization and occlusion handling. Our approach tackles these challenges using the normal equation to solve a visibility-weighted least squares problem for every Gaussian and can be implemented efficiently with existing differentiable rasterizers. We demonstrate the effectiveness of our approach on scene relighting, feature enrichment and 3D semantic segmentation tasks, achieving up to an order of magnitude speedup compared to gradient descent-based baselines.
format Preprint
id arxiv_https___arxiv_org_abs_2604_17155
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Instant Colorization of Gaussian Splats
Lieber, Daniel
Mock, Alexander
Wandel, Nils
Computer Vision and Pattern Recognition
Graphics
Gaussian Splatting has recently become one of the most popular frameworks for photorealistic 3D scene reconstruction and rendering. While current rasterizers allow for efficient mappings of 3D Gaussian splats onto 2D camera views, this work focuses on mapping 2D image information (e.g. color, neural features or segmentation masks) efficiently back onto an existing scene of Gaussian splats. This 'opposite' direction enables applications ranging from scene relighting and stylization to 3D semantic segmentation, but also introduces challenges, such as view-dependent colorization and occlusion handling. Our approach tackles these challenges using the normal equation to solve a visibility-weighted least squares problem for every Gaussian and can be implemented efficiently with existing differentiable rasterizers. We demonstrate the effectiveness of our approach on scene relighting, feature enrichment and 3D semantic segmentation tasks, achieving up to an order of magnitude speedup compared to gradient descent-based baselines.
title Instant Colorization of Gaussian Splats
topic Computer Vision and Pattern Recognition
Graphics
url https://arxiv.org/abs/2604.17155