GroundUp: Rapid Sketch-Based 3D City Massing

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Unlu, Gizem Esra, Sayed, Mohamed, Gryaditskaya, Yulia, Brostow, Gabriel
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913434521567232
author Unlu, Gizem Esra
Sayed, Mohamed
Gryaditskaya, Yulia
Brostow, Gabriel
author_facet Unlu, Gizem Esra
Sayed, Mohamed
Gryaditskaya, Yulia
Brostow, Gabriel
contents We propose GroundUp, the first sketch-based ideation tool for 3D city massing of urban areas. We focus on early-stage urban design, where sketching is a common tool and the design starts from balancing building volumes (masses) and open spaces. With Human-Centered AI in mind, we aim to help architects quickly revise their ideas by easily switching between 2D sketches and 3D models, allowing for smoother iteration and sharing of ideas. Inspired by feedback from architects and existing workflows, our system takes as a first input a user sketch of multiple buildings in a top-down view. The user then draws a perspective sketch of the envisioned site. Our method is designed to exploit the complementarity of information in the two sketches and allows users to quickly preview and adjust the inferred 3D shapes. Our model has two main components. First, we propose a novel sketch-to-depth prediction network for perspective sketches that exploits top-down sketch shapes. Second, we use depth cues derived from the perspective sketch as a condition to our diffusion model, which ultimately completes the geometry in a top-down view. Thus, our final 3D geometry is represented as a heightfield, allowing users to construct the city `from the ground up'.
format Preprint
id arxiv_https___arxiv_org_abs_2407_12739
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle GroundUp: Rapid Sketch-Based 3D City Massing
Unlu, Gizem Esra
Sayed, Mohamed
Gryaditskaya, Yulia
Brostow, Gabriel
Computer Vision and Pattern Recognition
Human-Computer Interaction
We propose GroundUp, the first sketch-based ideation tool for 3D city massing of urban areas. We focus on early-stage urban design, where sketching is a common tool and the design starts from balancing building volumes (masses) and open spaces. With Human-Centered AI in mind, we aim to help architects quickly revise their ideas by easily switching between 2D sketches and 3D models, allowing for smoother iteration and sharing of ideas. Inspired by feedback from architects and existing workflows, our system takes as a first input a user sketch of multiple buildings in a top-down view. The user then draws a perspective sketch of the envisioned site. Our method is designed to exploit the complementarity of information in the two sketches and allows users to quickly preview and adjust the inferred 3D shapes. Our model has two main components. First, we propose a novel sketch-to-depth prediction network for perspective sketches that exploits top-down sketch shapes. Second, we use depth cues derived from the perspective sketch as a condition to our diffusion model, which ultimately completes the geometry in a top-down view. Thus, our final 3D geometry is represented as a heightfield, allowing users to construct the city `from the ground up'.
title GroundUp: Rapid Sketch-Based 3D City Massing
topic Computer Vision and Pattern Recognition
Human-Computer Interaction
url https://arxiv.org/abs/2407.12739