SAM 3D for 3D Object Reconstruction from Remote Sensing Images

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yao, Junsheng, Mou, Lichao, Li, Qingyu
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918264483872768
author Yao, Junsheng
Mou, Lichao
Li, Qingyu
author_facet Yao, Junsheng
Mou, Lichao
Li, Qingyu
contents Monocular 3D building reconstruction from remote sensing imagery is essential for scalable urban modeling, yet existing methods often require task-specific architectures and intensive supervision. This paper presents the first systematic evaluation of SAM 3D, a general-purpose image-to-3D foundation model, for monocular remote sensing building reconstruction. We benchmark SAM 3D against TRELLIS on samples from the NYC Urban Dataset, employing Frechet Inception Distance (FID) and CLIP-based Maximum Mean Discrepancy (CMMD) as evaluation metrics. Experimental results demonstrate that SAM 3D produces more coherent roof geometry and sharper boundaries compared to TRELLIS. We further extend SAM 3D to urban scene reconstruction through a segment-reconstruct-compose pipeline, demonstrating its potential for urban scene modeling. We also analyze practical limitations and discuss future research directions. These findings provide practical guidance for deploying foundation models in urban 3D reconstruction and motivate future integration of scene-level structural priors.
format Preprint
id arxiv_https___arxiv_org_abs_2512_22452
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SAM 3D for 3D Object Reconstruction from Remote Sensing Images
Yao, Junsheng
Mou, Lichao
Li, Qingyu
Computer Vision and Pattern Recognition
Monocular 3D building reconstruction from remote sensing imagery is essential for scalable urban modeling, yet existing methods often require task-specific architectures and intensive supervision. This paper presents the first systematic evaluation of SAM 3D, a general-purpose image-to-3D foundation model, for monocular remote sensing building reconstruction. We benchmark SAM 3D against TRELLIS on samples from the NYC Urban Dataset, employing Frechet Inception Distance (FID) and CLIP-based Maximum Mean Discrepancy (CMMD) as evaluation metrics. Experimental results demonstrate that SAM 3D produces more coherent roof geometry and sharper boundaries compared to TRELLIS. We further extend SAM 3D to urban scene reconstruction through a segment-reconstruct-compose pipeline, demonstrating its potential for urban scene modeling. We also analyze practical limitations and discuss future research directions. These findings provide practical guidance for deploying foundation models in urban 3D reconstruction and motivate future integration of scene-level structural priors.
title SAM 3D for 3D Object Reconstruction from Remote Sensing Images
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2512.22452