StyledStreets: Multi-style Street Simulator with Spatial and Temporal Consistency

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Chen, Yuyin, Wang, Yida, Zhang, Xueyang, Zhan, Kun, Jia, Peng, Zhan, Yifei, Lang, Xianpeng
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915215146221568
author Chen, Yuyin
Wang, Yida
Zhang, Xueyang
Zhan, Kun
Jia, Peng
Zhan, Yifei
Lang, Xianpeng
author_facet Chen, Yuyin
Wang, Yida
Zhang, Xueyang
Zhan, Kun
Jia, Peng
Zhan, Yifei
Lang, Xianpeng
contents Urban scene reconstruction requires modeling both static infrastructure and dynamic elements while supporting diverse environmental conditions. We present \textbf{StyledStreets}, a multi-style street simulator that achieves instruction-driven scene editing with guaranteed spatial and temporal consistency. Building on a state-of-the-art Gaussian Splatting framework for street scenarios enhanced by our proposed pose optimization and multi-view training, our method enables photorealistic style transfers across seasons, weather conditions, and camera setups through three key innovations: First, a hybrid embedding scheme disentangles persistent scene geometry from transient style attributes, allowing realistic environmental edits while preserving structural integrity. Second, uncertainty-aware rendering mitigates supervision noise from diffusion priors, enabling robust training across extreme style variations. Third, a unified parametric model prevents geometric drift through regularized updates, maintaining multi-view consistency across seven vehicle-mounted cameras. Our framework preserves the original scene's motion patterns and geometric relationships. Qualitative results demonstrate plausible transitions between diverse conditions (snow, sandstorm, night), while quantitative evaluations show state-of-the-art geometric accuracy under style transfers. The approach establishes new capabilities for urban simulation, with applications in autonomous vehicle testing and augmented reality systems requiring reliable environmental consistency. Codes will be publicly available upon publication.
format Preprint
id arxiv_https___arxiv_org_abs_2503_21104
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle StyledStreets: Multi-style Street Simulator with Spatial and Temporal Consistency
Chen, Yuyin
Wang, Yida
Zhang, Xueyang
Zhan, Kun
Jia, Peng
Zhan, Yifei
Lang, Xianpeng
Computer Vision and Pattern Recognition
Urban scene reconstruction requires modeling both static infrastructure and dynamic elements while supporting diverse environmental conditions. We present \textbf{StyledStreets}, a multi-style street simulator that achieves instruction-driven scene editing with guaranteed spatial and temporal consistency. Building on a state-of-the-art Gaussian Splatting framework for street scenarios enhanced by our proposed pose optimization and multi-view training, our method enables photorealistic style transfers across seasons, weather conditions, and camera setups through three key innovations: First, a hybrid embedding scheme disentangles persistent scene geometry from transient style attributes, allowing realistic environmental edits while preserving structural integrity. Second, uncertainty-aware rendering mitigates supervision noise from diffusion priors, enabling robust training across extreme style variations. Third, a unified parametric model prevents geometric drift through regularized updates, maintaining multi-view consistency across seven vehicle-mounted cameras. Our framework preserves the original scene's motion patterns and geometric relationships. Qualitative results demonstrate plausible transitions between diverse conditions (snow, sandstorm, night), while quantitative evaluations show state-of-the-art geometric accuracy under style transfers. The approach establishes new capabilities for urban simulation, with applications in autonomous vehicle testing and augmented reality systems requiring reliable environmental consistency. Codes will be publicly available upon publication.
title StyledStreets: Multi-style Street Simulator with Spatial and Temporal Consistency
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.21104