Saved in:
Bibliographic Details
Main Authors: Booranamaitree, Warissara, Du, Xusheng, Cai, Yushu, Wang, Zhengyang, Zhang, Ye, Xie, Haoran
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2601.08531
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917199354003456
author Booranamaitree, Warissara
Du, Xusheng
Cai, Yushu
Wang, Zhengyang
Zhang, Ye
Xie, Haoran
author_facet Booranamaitree, Warissara
Du, Xusheng
Cai, Yushu
Wang, Zhengyang
Zhang, Ye
Xie, Haoran
contents Facade renovation offers a more sustainable alternative to full demolition, yet producing design proposals that preserve existing structures while expressing new intent remains challenging. Current workflows typically require detailed as-built modelling before design, which is time-consuming, labour-intensive, and often involves repeated revisions. To solve this issue, we propose a three-stage framework combining generative artificial intelligence (AI) and vision-language models (VLM) that directly processes rough structural sketch and textual descriptions to produce consistent renovation proposals. First, the input sketch is used by a fine-tuned VLM model to predict bounding boxes specifying where modifications are needed and which components should be added. Next, a stable diffusion model generates detailed sketches of new elements, which are merged with the original outline through a generative inpainting pipeline. Finally, ControlNet is employed to refine the result into a photorealistic image. Experiments on datasets and real industrial buildings indicate that the proposed framework can generate renovation proposals that preserve the original structure while improving facade detail quality. This approach effectively bypasses the need for detailed as-built modelling, enabling architects to rapidly explore design alternatives, iterate on early-stage concepts, and communicate renovation intentions with greater clarity.
format Preprint
id arxiv_https___arxiv_org_abs_2601_08531
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Sketch-Based Facade Renovation With Generative AI: A Streamlined Framework for Bypassing As-Built Modelling in Industrial Adaptive Reuse
Booranamaitree, Warissara
Du, Xusheng
Cai, Yushu
Wang, Zhengyang
Zhang, Ye
Xie, Haoran
Artificial Intelligence
Facade renovation offers a more sustainable alternative to full demolition, yet producing design proposals that preserve existing structures while expressing new intent remains challenging. Current workflows typically require detailed as-built modelling before design, which is time-consuming, labour-intensive, and often involves repeated revisions. To solve this issue, we propose a three-stage framework combining generative artificial intelligence (AI) and vision-language models (VLM) that directly processes rough structural sketch and textual descriptions to produce consistent renovation proposals. First, the input sketch is used by a fine-tuned VLM model to predict bounding boxes specifying where modifications are needed and which components should be added. Next, a stable diffusion model generates detailed sketches of new elements, which are merged with the original outline through a generative inpainting pipeline. Finally, ControlNet is employed to refine the result into a photorealistic image. Experiments on datasets and real industrial buildings indicate that the proposed framework can generate renovation proposals that preserve the original structure while improving facade detail quality. This approach effectively bypasses the need for detailed as-built modelling, enabling architects to rapidly explore design alternatives, iterate on early-stage concepts, and communicate renovation intentions with greater clarity.
title Sketch-Based Facade Renovation With Generative AI: A Streamlined Framework for Bypassing As-Built Modelling in Industrial Adaptive Reuse
topic Artificial Intelligence
url https://arxiv.org/abs/2601.08531