SceneLinker: Compositional 3D Scene Generation via Semantic Scene Graph from RGB Sequences

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Kim, Seok-Young, Kim, Dooyoung, Cho, Woojin, Song, Hail, Kang, Suji, Woo, Woontack
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912871561035776
author Kim, Seok-Young
Kim, Dooyoung
Cho, Woojin
Song, Hail
Kang, Suji
Woo, Woontack
author_facet Kim, Seok-Young
Kim, Dooyoung
Cho, Woojin
Song, Hail
Kang, Suji
Woo, Woontack
contents We introduce SceneLinker, a novel framework that generates compositional 3D scenes via semantic scene graph from RGB sequences. To adaptively experience Mixed Reality (MR) content based on each user's space, it is essential to generate a 3D scene that reflects the real-world layout by compactly capturing the semantic cues of the surroundings. Prior works struggled to fully capture the contextual relationship between objects or mainly focused on synthesizing diverse shapes, making it challenging to generate 3D scenes aligned with object arrangements. We address these challenges by designing a graph network with cross-check feature attention for scene graph prediction and constructing a graph-variational autoencoder (graph-VAE), which consists of a joint shape and layout block for 3D scene generation. Experiments on the 3RScan/3DSSG and SG-FRONT datasets demonstrate that our approach outperforms state-of-the-art methods in both quantitative and qualitative evaluations, even in complex indoor environments and under challenging scene graph constraints. Our work enables users to generate consistent 3D spaces from their physical environments via scene graphs, allowing them to create spatial MR content. Project page is https://scenelinker2026.github.io.
format Preprint
id arxiv_https___arxiv_org_abs_2602_02974
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle SceneLinker: Compositional 3D Scene Generation via Semantic Scene Graph from RGB Sequences
Kim, Seok-Young
Kim, Dooyoung
Cho, Woojin
Song, Hail
Kang, Suji
Woo, Woontack
Computer Vision and Pattern Recognition
We introduce SceneLinker, a novel framework that generates compositional 3D scenes via semantic scene graph from RGB sequences. To adaptively experience Mixed Reality (MR) content based on each user's space, it is essential to generate a 3D scene that reflects the real-world layout by compactly capturing the semantic cues of the surroundings. Prior works struggled to fully capture the contextual relationship between objects or mainly focused on synthesizing diverse shapes, making it challenging to generate 3D scenes aligned with object arrangements. We address these challenges by designing a graph network with cross-check feature attention for scene graph prediction and constructing a graph-variational autoencoder (graph-VAE), which consists of a joint shape and layout block for 3D scene generation. Experiments on the 3RScan/3DSSG and SG-FRONT datasets demonstrate that our approach outperforms state-of-the-art methods in both quantitative and qualitative evaluations, even in complex indoor environments and under challenging scene graph constraints. Our work enables users to generate consistent 3D spaces from their physical environments via scene graphs, allowing them to create spatial MR content. Project page is https://scenelinker2026.github.io.
title SceneLinker: Compositional 3D Scene Generation via Semantic Scene Graph from RGB Sequences
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2602.02974