RoomDiffusion: A Specialized Diffusion Model in the Interior Design Industry
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866929487384412160 |
|---|---|
| author | Wang, Zhaowei Hao, Ying Wei, Hao Xiao, Qing Chen, Lulu Li, Yulong Yang, Yue Li, Tianyi |
| author_facet | Wang, Zhaowei Hao, Ying Wei, Hao Xiao, Qing Chen, Lulu Li, Yulong Yang, Yue Li, Tianyi |
| contents | Recent advancements in text-to-image diffusion models have significantly transformed visual content generation, yet their application in specialized fields such as interior design remains underexplored. In this paper, we present RoomDiffusion, a pioneering diffusion model meticulously tailored for the interior design industry. To begin with, we build from scratch a whole data pipeline to update and evaluate data for iterative model optimization. Subsequently, techniques such as multiaspect training, multi-stage fine-tune and model fusion are applied to enhance both the visual appeal and precision of the generated results. Lastly, leveraging the latent consistency Distillation method, we distill and expedite the model for optimal efficiency. Unlike existing models optimized for general scenarios, RoomDiffusion addresses specific challenges in interior design, such as lack of fashion, high furniture duplication rate, and inaccurate style. Through our holistic human evaluation protocol with more than 20 professional human evaluators, RoomDiffusion demonstrates industry-leading performance in terms of aesthetics, accuracy, and efficiency, surpassing all existing open source models such as stable diffusion and SDXL. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_03198 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | RoomDiffusion: A Specialized Diffusion Model in the Interior Design Industry Wang, Zhaowei Hao, Ying Wei, Hao Xiao, Qing Chen, Lulu Li, Yulong Yang, Yue Li, Tianyi Computer Vision and Pattern Recognition Recent advancements in text-to-image diffusion models have significantly transformed visual content generation, yet their application in specialized fields such as interior design remains underexplored. In this paper, we present RoomDiffusion, a pioneering diffusion model meticulously tailored for the interior design industry. To begin with, we build from scratch a whole data pipeline to update and evaluate data for iterative model optimization. Subsequently, techniques such as multiaspect training, multi-stage fine-tune and model fusion are applied to enhance both the visual appeal and precision of the generated results. Lastly, leveraging the latent consistency Distillation method, we distill and expedite the model for optimal efficiency. Unlike existing models optimized for general scenarios, RoomDiffusion addresses specific challenges in interior design, such as lack of fashion, high furniture duplication rate, and inaccurate style. Through our holistic human evaluation protocol with more than 20 professional human evaluators, RoomDiffusion demonstrates industry-leading performance in terms of aesthetics, accuracy, and efficiency, surpassing all existing open source models such as stable diffusion and SDXL. |
| title | RoomDiffusion: A Specialized Diffusion Model in the Interior Design Industry |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2409.03198 |