Salvato in:
Dettagli Bibliografici
Autori principali: Chen, Jianing, Li, Zehao, Cai, Yujun, Jiang, Hao, Gao, Shuqin, Zhao, Honglong, Mao, Tianlu, Zhang, Yucheng
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:https://arxiv.org/abs/2510.02732
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915531796250624
author Chen, Jianing
Li, Zehao
Cai, Yujun
Jiang, Hao
Gao, Shuqin
Zhao, Honglong
Mao, Tianlu
Zhang, Yucheng
author_facet Chen, Jianing
Li, Zehao
Cai, Yujun
Jiang, Hao
Gao, Shuqin
Zhao, Honglong
Mao, Tianlu
Zhang, Yucheng
contents Dynamic 3D reconstruction from monocular videos remains difficult due to the ambiguity inferring 3D motion from limited views and computational demands of modeling temporally varying scenes. While recent sparse control methods alleviate computation by reducing millions of Gaussians to thousands of control points, they suffer from a critical limitation: they allocate points purely by geometry, leading to static redundancy and dynamic insufficiency. We propose a motion-adaptive framework that aligns control density with motion complexity. Leveraging semantic and motion priors from vision foundation models, we establish patch-token-node correspondences and apply motion-adaptive compression to concentrate control points in dynamic regions while suppressing redundancy in static backgrounds. Our approach achieves flexible representational density adaptation through iterative voxelization and motion tendency scoring, directly addressing the fundamental mismatch between control point allocation and motion complexity. To capture temporal evolution, we introduce spline-based trajectory parameterization initialized by 2D tracklets, replacing MLP-based deformation fields to achieve smoother motion representation and more stable optimization. Extensive experiments demonstrate significant improvements in reconstruction quality and efficiency over existing state-of-the-art methods.
format Preprint
id arxiv_https___arxiv_org_abs_2510_02732
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle From Tokens to Nodes: Semantic-Guided Motion Control for Dynamic 3D Gaussian Splatting
Chen, Jianing
Li, Zehao
Cai, Yujun
Jiang, Hao
Gao, Shuqin
Zhao, Honglong
Mao, Tianlu
Zhang, Yucheng
Computer Vision and Pattern Recognition
Dynamic 3D reconstruction from monocular videos remains difficult due to the ambiguity inferring 3D motion from limited views and computational demands of modeling temporally varying scenes. While recent sparse control methods alleviate computation by reducing millions of Gaussians to thousands of control points, they suffer from a critical limitation: they allocate points purely by geometry, leading to static redundancy and dynamic insufficiency. We propose a motion-adaptive framework that aligns control density with motion complexity. Leveraging semantic and motion priors from vision foundation models, we establish patch-token-node correspondences and apply motion-adaptive compression to concentrate control points in dynamic regions while suppressing redundancy in static backgrounds. Our approach achieves flexible representational density adaptation through iterative voxelization and motion tendency scoring, directly addressing the fundamental mismatch between control point allocation and motion complexity. To capture temporal evolution, we introduce spline-based trajectory parameterization initialized by 2D tracklets, replacing MLP-based deformation fields to achieve smoother motion representation and more stable optimization. Extensive experiments demonstrate significant improvements in reconstruction quality and efficiency over existing state-of-the-art methods.
title From Tokens to Nodes: Semantic-Guided Motion Control for Dynamic 3D Gaussian Splatting
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2510.02732