S-VGGT: Structure-Aware Subscene Decomposition for Scalable 3D Foundation Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Li, Xinze, Chen, Pengxu, Wang, Yiyuan, Su, Weifeng, Cheng, Wentao
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914405929713664
author Li, Xinze
Chen, Pengxu
Wang, Yiyuan
Su, Weifeng
Cheng, Wentao
author_facet Li, Xinze
Chen, Pengxu
Wang, Yiyuan
Su, Weifeng
Cheng, Wentao
contents Feed-forward 3D foundation models face a key challenge: the quadratic computational cost introduced by global attention, which severely limits scalability as input length increases. Concurrent acceleration methods, such as token merging, operate at the token level. While they offer local savings, the required nearest-neighbor searches introduce undesirable overhead. Consequently, these techniques fail to tackle the fundamental issue of structural redundancy dominant in dense capture data. In this work, we introduce \textbf{S-VGGT}, a novel approach that addresses redundancy at the structural frame level, drastically shifting the optimization focus. We first leverage the initial features to build a dense scene graph, which characterizes structural scene redundancy and guides the subsequent scene partitioning. Using this graph, we softly assign frames to a small number of subscenes, guaranteeing balanced groups and smooth geometric transitions. The core innovation lies in designing the subscenes to share a common reference frame, establishing a parallel geometric bridge that enables independent and highly efficient processing without explicit geometric alignment. This structural reorganization provides strong intrinsic acceleration by cutting the global attention cost at its source. Crucially, S-VGGT is entirely orthogonal to token-level acceleration methods, allowing the two to be seamlessly combined for compounded speedups without compromising reconstruction fidelity. Code is available at https://github.com/Powertony102/S-VGGT.
format Preprint
id arxiv_https___arxiv_org_abs_2603_17625
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle S-VGGT: Structure-Aware Subscene Decomposition for Scalable 3D Foundation Models
Li, Xinze
Chen, Pengxu
Wang, Yiyuan
Su, Weifeng
Cheng, Wentao
Computer Vision and Pattern Recognition
Feed-forward 3D foundation models face a key challenge: the quadratic computational cost introduced by global attention, which severely limits scalability as input length increases. Concurrent acceleration methods, such as token merging, operate at the token level. While they offer local savings, the required nearest-neighbor searches introduce undesirable overhead. Consequently, these techniques fail to tackle the fundamental issue of structural redundancy dominant in dense capture data. In this work, we introduce \textbf{S-VGGT}, a novel approach that addresses redundancy at the structural frame level, drastically shifting the optimization focus. We first leverage the initial features to build a dense scene graph, which characterizes structural scene redundancy and guides the subsequent scene partitioning. Using this graph, we softly assign frames to a small number of subscenes, guaranteeing balanced groups and smooth geometric transitions. The core innovation lies in designing the subscenes to share a common reference frame, establishing a parallel geometric bridge that enables independent and highly efficient processing without explicit geometric alignment. This structural reorganization provides strong intrinsic acceleration by cutting the global attention cost at its source. Crucially, S-VGGT is entirely orthogonal to token-level acceleration methods, allowing the two to be seamlessly combined for compounded speedups without compromising reconstruction fidelity. Code is available at https://github.com/Powertony102/S-VGGT.
title S-VGGT: Structure-Aware Subscene Decomposition for Scalable 3D Foundation Models
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.17625