Augmented Reality in Cultural Heritage: A Dual-Model Pipeline for 3D Artwork Reconstruction

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Pannone, Daniele, Castronovo, Alessia, Mancini, Maurizio, Foresti, Gian Luca, Piciarelli, Claudio, Gabrieli, Rossana, Bilal, Muhammad Yasir, Avola, Danilo
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913948607971328
author Pannone, Daniele
Castronovo, Alessia
Mancini, Maurizio
Foresti, Gian Luca
Piciarelli, Claudio
Gabrieli, Rossana
Bilal, Muhammad Yasir
Avola, Danilo
author_facet Pannone, Daniele
Castronovo, Alessia
Mancini, Maurizio
Foresti, Gian Luca
Piciarelli, Claudio
Gabrieli, Rossana
Bilal, Muhammad Yasir
Avola, Danilo
contents This paper presents an innovative augmented reality pipeline tailored for museum environments, aimed at recognizing artworks and generating accurate 3D models from single images. By integrating two complementary pre-trained depth estimation models, i.e., GLPN for capturing global scene structure and Depth-Anything for detailed local reconstruction, the proposed approach produces optimized depth maps that effectively represent complex artistic features. These maps are then converted into high-quality point clouds and meshes, enabling the creation of immersive AR experiences. The methodology leverages state-of-the-art neural network architectures and advanced computer vision techniques to overcome challenges posed by irregular contours and variable textures in artworks. Experimental results demonstrate significant improvements in reconstruction accuracy and visual realism, making the system a highly robust tool for museums seeking to enhance visitor engagement through interactive digital content.
format Preprint
id arxiv_https___arxiv_org_abs_2507_13719
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Augmented Reality in Cultural Heritage: A Dual-Model Pipeline for 3D Artwork Reconstruction
Pannone, Daniele
Castronovo, Alessia
Mancini, Maurizio
Foresti, Gian Luca
Piciarelli, Claudio
Gabrieli, Rossana
Bilal, Muhammad Yasir
Avola, Danilo
Computer Vision and Pattern Recognition
This paper presents an innovative augmented reality pipeline tailored for museum environments, aimed at recognizing artworks and generating accurate 3D models from single images. By integrating two complementary pre-trained depth estimation models, i.e., GLPN for capturing global scene structure and Depth-Anything for detailed local reconstruction, the proposed approach produces optimized depth maps that effectively represent complex artistic features. These maps are then converted into high-quality point clouds and meshes, enabling the creation of immersive AR experiences. The methodology leverages state-of-the-art neural network architectures and advanced computer vision techniques to overcome challenges posed by irregular contours and variable textures in artworks. Experimental results demonstrate significant improvements in reconstruction accuracy and visual realism, making the system a highly robust tool for museums seeking to enhance visitor engagement through interactive digital content.
title Augmented Reality in Cultural Heritage: A Dual-Model Pipeline for 3D Artwork Reconstruction
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.13719