VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifold

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Maggio, Dominic, Lim, Hyungtae, Carlone, Luca
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916754058379264
author Maggio, Dominic
Lim, Hyungtae
Carlone, Luca
author_facet Maggio, Dominic
Lim, Hyungtae
Carlone, Luca
contents We present VGGT-SLAM, a dense RGB SLAM system constructed by incrementally and globally aligning submaps created from the feed-forward scene reconstruction approach VGGT using only uncalibrated monocular cameras. While related works align submaps using similarity transforms (i.e., translation, rotation, and scale), we show that such approaches are inadequate in the case of uncalibrated cameras. In particular, we revisit the idea of reconstruction ambiguity, where given a set of uncalibrated cameras with no assumption on the camera motion or scene structure, the scene can only be reconstructed up to a 15-degrees-of-freedom projective transformation of the true geometry. This inspires us to recover a consistent scene reconstruction across submaps by optimizing over the SL(4) manifold, thus estimating 15-degrees-of-freedom homography transforms between sequential submaps while accounting for potential loop closure constraints. As verified by extensive experiments, we demonstrate that VGGT-SLAM achieves improved map quality using long video sequences that are infeasible for VGGT due to its high GPU requirements.
format Preprint
id arxiv_https___arxiv_org_abs_2505_12549
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifold
Maggio, Dominic
Lim, Hyungtae
Carlone, Luca
Computer Vision and Pattern Recognition
We present VGGT-SLAM, a dense RGB SLAM system constructed by incrementally and globally aligning submaps created from the feed-forward scene reconstruction approach VGGT using only uncalibrated monocular cameras. While related works align submaps using similarity transforms (i.e., translation, rotation, and scale), we show that such approaches are inadequate in the case of uncalibrated cameras. In particular, we revisit the idea of reconstruction ambiguity, where given a set of uncalibrated cameras with no assumption on the camera motion or scene structure, the scene can only be reconstructed up to a 15-degrees-of-freedom projective transformation of the true geometry. This inspires us to recover a consistent scene reconstruction across submaps by optimizing over the SL(4) manifold, thus estimating 15-degrees-of-freedom homography transforms between sequential submaps while accounting for potential loop closure constraints. As verified by extensive experiments, we demonstrate that VGGT-SLAM achieves improved map quality using long video sequences that are infeasible for VGGT due to its high GPU requirements.
title VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifold
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2505.12549