GA-GS: Generation-Assisted Gaussian Splatting for Static Scene Reconstruction

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Shen, Yedong, Zhang, Shiqi, Zhang, Sha, Duan, Yifan, Zhang, Xinran, Yu, Wenhao, Zhang, Lu, Deng, Jiajun, Zhang, Yanyong
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913007183855616
author Shen, Yedong
Zhang, Shiqi
Zhang, Sha
Duan, Yifan
Zhang, Xinran
Yu, Wenhao
Zhang, Lu
Deng, Jiajun
Zhang, Yanyong
author_facet Shen, Yedong
Zhang, Shiqi
Zhang, Sha
Duan, Yifan
Zhang, Xinran
Yu, Wenhao
Zhang, Lu
Deng, Jiajun
Zhang, Yanyong
contents Reconstructing static 3D scene from monocular video with dynamic objects is important for numerous applications such as virtual reality and autonomous driving. Current approaches typically rely on background for static scene reconstruction, limiting the ability to recover regions occluded by dynamic objects. In this paper, we propose GA-GS, a Generation-Assisted Gaussian Splatting method for Static Scene Reconstruction. The key innovation of our work lies in leveraging generation to assist in reconstructing occluded regions. We employ a motion-aware module to segment and remove dynamic regions, and thenuse a diffusion model to inpaint the occluded areas, providing pseudo-ground-truth supervision. To balance contributions from real background and generated region, we introduce a learnable authenticity scalar for each Gaussian primitive, which dynamically modulates opacity during splatting for authenticity-aware rendering and supervision. Since no existing dataset provides ground-truth static scene of video with dynamic objects, we construct a dataset named Trajectory-Match, using a fixed-path robot to record each scene with/without dynamic objects, enabling quantitative evaluation in reconstruction of occluded regions. Extensive experiments on both the DAVIS and our dataset show that GA-GS achieves state-of-the-art performance in static scene reconstruction, especially in challenging scenarios with large-scale, persistent occlusions.
format Preprint
id arxiv_https___arxiv_org_abs_2604_04331
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle GA-GS: Generation-Assisted Gaussian Splatting for Static Scene Reconstruction
Shen, Yedong
Zhang, Shiqi
Zhang, Sha
Duan, Yifan
Zhang, Xinran
Yu, Wenhao
Zhang, Lu
Deng, Jiajun
Zhang, Yanyong
Computer Vision and Pattern Recognition
Artificial Intelligence
Reconstructing static 3D scene from monocular video with dynamic objects is important for numerous applications such as virtual reality and autonomous driving. Current approaches typically rely on background for static scene reconstruction, limiting the ability to recover regions occluded by dynamic objects. In this paper, we propose GA-GS, a Generation-Assisted Gaussian Splatting method for Static Scene Reconstruction. The key innovation of our work lies in leveraging generation to assist in reconstructing occluded regions. We employ a motion-aware module to segment and remove dynamic regions, and thenuse a diffusion model to inpaint the occluded areas, providing pseudo-ground-truth supervision. To balance contributions from real background and generated region, we introduce a learnable authenticity scalar for each Gaussian primitive, which dynamically modulates opacity during splatting for authenticity-aware rendering and supervision. Since no existing dataset provides ground-truth static scene of video with dynamic objects, we construct a dataset named Trajectory-Match, using a fixed-path robot to record each scene with/without dynamic objects, enabling quantitative evaluation in reconstruction of occluded regions. Extensive experiments on both the DAVIS and our dataset show that GA-GS achieves state-of-the-art performance in static scene reconstruction, especially in challenging scenarios with large-scale, persistent occlusions.
title GA-GS: Generation-Assisted Gaussian Splatting for Static Scene Reconstruction
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2604.04331