I-Design: Personalized LLM Interior Designer

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Çelen, Ata, Han, Guo, Schindler, Konrad, Van Gool, Luc, Armeni, Iro, Obukhov, Anton, Wang, Xi
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915564551667712
author Çelen, Ata
Han, Guo
Schindler, Konrad
Van Gool, Luc
Armeni, Iro
Obukhov, Anton
Wang, Xi
author_facet Çelen, Ata
Han, Guo
Schindler, Konrad
Van Gool, Luc
Armeni, Iro
Obukhov, Anton
Wang, Xi
contents Interior design allows us to be who we are and live how we want - each design is as unique as our distinct personality. However, it is not trivial for non-professionals to express and materialize this since it requires aligning functional and visual expectations with the constraints of physical space; this renders interior design a luxury. To make it more accessible, we present I-Design, a personalized interior designer that allows users to generate and visualize their design goals through natural language communication. I-Design starts with a team of large language model agents that engage in dialogues and logical reasoning with one another, transforming textual user input into feasible scene graph designs with relative object relationships. Subsequently, an effective placement algorithm determines optimal locations for each object within the scene. The final design is then constructed in 3D by retrieving and integrating assets from an existing object database. Additionally, we propose a new evaluation protocol that utilizes a vision-language model and complements the design pipeline. Extensive quantitative and qualitative experiments show that I-Design outperforms existing methods in delivering high-quality 3D design solutions and aligning with abstract concepts that match user input, showcasing its advantages across detailed 3D arrangement and conceptual fidelity.
format Preprint
id arxiv_https___arxiv_org_abs_2404_02838
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle I-Design: Personalized LLM Interior Designer
Çelen, Ata
Han, Guo
Schindler, Konrad
Van Gool, Luc
Armeni, Iro
Obukhov, Anton
Wang, Xi
Artificial Intelligence
Interior design allows us to be who we are and live how we want - each design is as unique as our distinct personality. However, it is not trivial for non-professionals to express and materialize this since it requires aligning functional and visual expectations with the constraints of physical space; this renders interior design a luxury. To make it more accessible, we present I-Design, a personalized interior designer that allows users to generate and visualize their design goals through natural language communication. I-Design starts with a team of large language model agents that engage in dialogues and logical reasoning with one another, transforming textual user input into feasible scene graph designs with relative object relationships. Subsequently, an effective placement algorithm determines optimal locations for each object within the scene. The final design is then constructed in 3D by retrieving and integrating assets from an existing object database. Additionally, we propose a new evaluation protocol that utilizes a vision-language model and complements the design pipeline. Extensive quantitative and qualitative experiments show that I-Design outperforms existing methods in delivering high-quality 3D design solutions and aligning with abstract concepts that match user input, showcasing its advantages across detailed 3D arrangement and conceptual fidelity.
title I-Design: Personalized LLM Interior Designer
topic Artificial Intelligence
url https://arxiv.org/abs/2404.02838