PrITTI: Primitive-based Generation of Controllable and Editable 3D Semantic Urban Scenes

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Tze, Christina Ourania, Dauner, Daniel, Liao, Yiyi, Tsishkou, Dzmitry, Geiger, Andreas
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910251186388992
author Tze, Christina Ourania
Dauner, Daniel
Liao, Yiyi
Tsishkou, Dzmitry
Geiger, Andreas
author_facet Tze, Christina Ourania
Dauner, Daniel
Liao, Yiyi
Tsishkou, Dzmitry
Geiger, Andreas
contents Existing approaches to 3D semantic urban scene generation predominantly rely on voxel-based representations, which are bound by fixed resolution, challenging to edit, and memory-intensive in their dense form. In contrast, we advocate for a primitive-based paradigm where urban scenes are represented using compact, semantically meaningful 3D elements that are easy to manipulate and compose. To this end, we introduce PrITTI, a latent diffusion model that leverages vectorized object primitives and rasterized ground surfaces for generating diverse, controllable, and editable 3D semantic urban scenes. This hybrid representation yields a structured latent space that facilitates object- and ground-level manipulation. Experiments on KITTI-360 show that primitive-based representations unlock the full capabilities of diffusion transformers, achieving state-of-the-art 3D scene generation quality with lower memory requirements, faster inference, and greater editability than voxel-based methods. Beyond generation, PrITTI supports a range of downstream applications, including scene editing, inpainting, outpainting, and photo-realistic street-view synthesis. The source code and more results can be found at https://raniatze.github.io/pritti/.
format Preprint
id arxiv_https___arxiv_org_abs_2506_19117
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle PrITTI: Primitive-based Generation of Controllable and Editable 3D Semantic Urban Scenes
Tze, Christina Ourania
Dauner, Daniel
Liao, Yiyi
Tsishkou, Dzmitry
Geiger, Andreas
Computer Vision and Pattern Recognition
Existing approaches to 3D semantic urban scene generation predominantly rely on voxel-based representations, which are bound by fixed resolution, challenging to edit, and memory-intensive in their dense form. In contrast, we advocate for a primitive-based paradigm where urban scenes are represented using compact, semantically meaningful 3D elements that are easy to manipulate and compose. To this end, we introduce PrITTI, a latent diffusion model that leverages vectorized object primitives and rasterized ground surfaces for generating diverse, controllable, and editable 3D semantic urban scenes. This hybrid representation yields a structured latent space that facilitates object- and ground-level manipulation. Experiments on KITTI-360 show that primitive-based representations unlock the full capabilities of diffusion transformers, achieving state-of-the-art 3D scene generation quality with lower memory requirements, faster inference, and greater editability than voxel-based methods. Beyond generation, PrITTI supports a range of downstream applications, including scene editing, inpainting, outpainting, and photo-realistic street-view synthesis. The source code and more results can be found at https://raniatze.github.io/pritti/.
title PrITTI: Primitive-based Generation of Controllable and Editable 3D Semantic Urban Scenes
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.19117