Imagine a City: CityGenAgent for Procedural 3D City Generation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Liu, Zishan, Tang, Zecong, Wu, RuoCheng, Zheng, Xinzhe, Hu, Jingyu, Hui, Ka-Hei, Xie, Haoran, Dai, Bo, Liu, Zhengzhe
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917298307072000
author Liu, Zishan
Tang, Zecong
Wu, RuoCheng
Zheng, Xinzhe
Hu, Jingyu
Hui, Ka-Hei
Xie, Haoran
Dai, Bo
Liu, Zhengzhe
author_facet Liu, Zishan
Tang, Zecong
Wu, RuoCheng
Zheng, Xinzhe
Hu, Jingyu
Hui, Ka-Hei
Xie, Haoran
Dai, Bo
Liu, Zhengzhe
contents The automated generation of interactive 3D cities is a critical challenge with broad applications in autonomous driving, virtual reality, and embodied intelligence. While recent advances in generative models and procedural techniques have improved the realism of city generation, existing methods often struggle with high-fidelity asset creation, controllability, and manipulation. In this work, we introduce CityGenAgent, a natural language-driven framework for hierarchical procedural generation of high-quality 3D cities. Our approach decomposes city generation into two interpretable components, Block Program and Building Program. To ensure structural correctness and semantic alignment, we adopt a two-stage learning strategy: (1) Supervised Fine-Tuning (SFT). We train BlockGen and BuildingGen to generate valid programs that adhere to schema constraints, including non-self-intersecting polygons and complete fields; (2) Reinforcement Learning (RL). We design Spatial Alignment Reward to enhance spatial reasoning ability and Visual Consistency Reward to bridge the gap between textual descriptions and the visual modality. Benefiting from the programs and the models' generalization, CityGenAgent supports natural language editing and manipulation. Comprehensive evaluations demonstrate superior semantic alignment, visual quality, and controllability compared to existing methods, establishing a robust foundation for scalable 3D city generation.
format Preprint
id arxiv_https___arxiv_org_abs_2602_05362
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Imagine a City: CityGenAgent for Procedural 3D City Generation
Liu, Zishan
Tang, Zecong
Wu, RuoCheng
Zheng, Xinzhe
Hu, Jingyu
Hui, Ka-Hei
Xie, Haoran
Dai, Bo
Liu, Zhengzhe
Computer Vision and Pattern Recognition
The automated generation of interactive 3D cities is a critical challenge with broad applications in autonomous driving, virtual reality, and embodied intelligence. While recent advances in generative models and procedural techniques have improved the realism of city generation, existing methods often struggle with high-fidelity asset creation, controllability, and manipulation. In this work, we introduce CityGenAgent, a natural language-driven framework for hierarchical procedural generation of high-quality 3D cities. Our approach decomposes city generation into two interpretable components, Block Program and Building Program. To ensure structural correctness and semantic alignment, we adopt a two-stage learning strategy: (1) Supervised Fine-Tuning (SFT). We train BlockGen and BuildingGen to generate valid programs that adhere to schema constraints, including non-self-intersecting polygons and complete fields; (2) Reinforcement Learning (RL). We design Spatial Alignment Reward to enhance spatial reasoning ability and Visual Consistency Reward to bridge the gap between textual descriptions and the visual modality. Benefiting from the programs and the models' generalization, CityGenAgent supports natural language editing and manipulation. Comprehensive evaluations demonstrate superior semantic alignment, visual quality, and controllability compared to existing methods, establishing a robust foundation for scalable 3D city generation.
title Imagine a City: CityGenAgent for Procedural 3D City Generation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2602.05362