ScenePainter: Semantically Consistent Perpetual 3D Scene Generation with Concept Relation Alignment

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Xia, Chong, Zhang, Shengjun, Liu, Fangfu, Liu, Chang, Hirunyaratsameewong, Khodchaphun, Duan, Yueqi
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912501038317568
author Xia, Chong
Zhang, Shengjun
Liu, Fangfu
Liu, Chang
Hirunyaratsameewong, Khodchaphun
Duan, Yueqi
author_facet Xia, Chong
Zhang, Shengjun
Liu, Fangfu
Liu, Chang
Hirunyaratsameewong, Khodchaphun
Duan, Yueqi
contents Perpetual 3D scene generation aims to produce long-range and coherent 3D view sequences, which is applicable for long-term video synthesis and 3D scene reconstruction. Existing methods follow a "navigate-and-imagine" fashion and rely on outpainting for successive view expansion. However, the generated view sequences suffer from semantic drift issue derived from the accumulated deviation of the outpainting module. To tackle this challenge, we propose ScenePainter, a new framework for semantically consistent 3D scene generation, which aligns the outpainter's scene-specific prior with the comprehension of the current scene. To be specific, we introduce a hierarchical graph structure dubbed SceneConceptGraph to construct relations among multi-level scene concepts, which directs the outpainter for consistent novel views and can be dynamically refined to enhance diversity. Extensive experiments demonstrate that our framework overcomes the semantic drift issue and generates more consistent and immersive 3D view sequences. Project Page: https://xiac20.github.io/ScenePainter/.
format Preprint
id arxiv_https___arxiv_org_abs_2507_19058
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ScenePainter: Semantically Consistent Perpetual 3D Scene Generation with Concept Relation Alignment
Xia, Chong
Zhang, Shengjun
Liu, Fangfu
Liu, Chang
Hirunyaratsameewong, Khodchaphun
Duan, Yueqi
Computer Vision and Pattern Recognition
Perpetual 3D scene generation aims to produce long-range and coherent 3D view sequences, which is applicable for long-term video synthesis and 3D scene reconstruction. Existing methods follow a "navigate-and-imagine" fashion and rely on outpainting for successive view expansion. However, the generated view sequences suffer from semantic drift issue derived from the accumulated deviation of the outpainting module. To tackle this challenge, we propose ScenePainter, a new framework for semantically consistent 3D scene generation, which aligns the outpainter's scene-specific prior with the comprehension of the current scene. To be specific, we introduce a hierarchical graph structure dubbed SceneConceptGraph to construct relations among multi-level scene concepts, which directs the outpainter for consistent novel views and can be dynamically refined to enhance diversity. Extensive experiments demonstrate that our framework overcomes the semantic drift issue and generates more consistent and immersive 3D view sequences. Project Page: https://xiac20.github.io/ScenePainter/.
title ScenePainter: Semantically Consistent Perpetual 3D Scene Generation with Concept Relation Alignment
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.19058