Gaussian Heritage: 3D Digitization of Cultural Heritage with Integrated Object Segmentation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Dahaghin, Mahtab, Castillo, Myrna, Riahidehkordi, Kourosh, Toso, Matteo, Del Bue, Alessio
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913521841733632
author Dahaghin, Mahtab
Castillo, Myrna
Riahidehkordi, Kourosh
Toso, Matteo
Del Bue, Alessio
author_facet Dahaghin, Mahtab
Castillo, Myrna
Riahidehkordi, Kourosh
Toso, Matteo
Del Bue, Alessio
contents The creation of digital replicas of physical objects has valuable applications for the preservation and dissemination of tangible cultural heritage. However, existing methods are often slow, expensive, and require expert knowledge. We propose a pipeline to generate a 3D replica of a scene using only RGB images (e.g. photos of a museum) and then extract a model for each item of interest (e.g. pieces in the exhibit). We do this by leveraging the advancements in novel view synthesis and Gaussian Splatting, modified to enable efficient 3D segmentation. This approach does not need manual annotation, and the visual inputs can be captured using a standard smartphone, making it both affordable and easy to deploy. We provide an overview of the method and baseline evaluation of the accuracy of object segmentation. The code is available at https://mahtaabdn.github.io/gaussian_heritage.github.io/.
format Preprint
id arxiv_https___arxiv_org_abs_2409_19039
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Gaussian Heritage: 3D Digitization of Cultural Heritage with Integrated Object Segmentation
Dahaghin, Mahtab
Castillo, Myrna
Riahidehkordi, Kourosh
Toso, Matteo
Del Bue, Alessio
Computer Vision and Pattern Recognition
The creation of digital replicas of physical objects has valuable applications for the preservation and dissemination of tangible cultural heritage. However, existing methods are often slow, expensive, and require expert knowledge. We propose a pipeline to generate a 3D replica of a scene using only RGB images (e.g. photos of a museum) and then extract a model for each item of interest (e.g. pieces in the exhibit). We do this by leveraging the advancements in novel view synthesis and Gaussian Splatting, modified to enable efficient 3D segmentation. This approach does not need manual annotation, and the visual inputs can be captured using a standard smartphone, making it both affordable and easy to deploy. We provide an overview of the method and baseline evaluation of the accuracy of object segmentation. The code is available at https://mahtaabdn.github.io/gaussian_heritage.github.io/.
title Gaussian Heritage: 3D Digitization of Cultural Heritage with Integrated Object Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2409.19039