Shaping Realities: Enhancing 3D Generative AI with Fabrication Constraints

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Faruqi, Faraz, Tian, Yingtao, Phadnis, Vrushank, Jampani, Varun, Mueller, Stefanie
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914758071943168
author Faruqi, Faraz
Tian, Yingtao
Phadnis, Vrushank
Jampani, Varun
Mueller, Stefanie
author_facet Faruqi, Faraz
Tian, Yingtao
Phadnis, Vrushank
Jampani, Varun
Mueller, Stefanie
contents Generative AI tools are becoming more prevalent in 3D modeling, enabling users to manipulate or create new models with text or images as inputs. This makes it easier for users to rapidly customize and iterate on their 3D designs and explore new creative ideas. These methods focus on the aesthetic quality of the 3D models, refining them to look similar to the prompts provided by the user. However, when creating 3D models intended for fabrication, designers need to trade-off the aesthetic qualities of a 3D model with their intended physical properties. To be functional post-fabrication, 3D models have to satisfy structural constraints informed by physical principles. Currently, such requirements are not enforced by generative AI tools. This leads to the development of aesthetically appealing, but potentially non-functional 3D geometry, that would be hard to fabricate and use in the real world. This workshop paper highlights the limitations of generative AI tools in translating digital creations into the physical world and proposes new augmentations to generative AI tools for creating physically viable 3D models. We advocate for the development of tools that manipulate or generate 3D models by considering not only the aesthetic appearance but also using physical properties as constraints. This exploration seeks to bridge the gap between digital creativity and real-world applicability, extending the creative potential of generative AI into the tangible domain.
format Preprint
id arxiv_https___arxiv_org_abs_2404_10142
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Shaping Realities: Enhancing 3D Generative AI with Fabrication Constraints
Faruqi, Faraz
Tian, Yingtao
Phadnis, Vrushank
Jampani, Varun
Mueller, Stefanie
Human-Computer Interaction
Artificial Intelligence
Generative AI tools are becoming more prevalent in 3D modeling, enabling users to manipulate or create new models with text or images as inputs. This makes it easier for users to rapidly customize and iterate on their 3D designs and explore new creative ideas. These methods focus on the aesthetic quality of the 3D models, refining them to look similar to the prompts provided by the user. However, when creating 3D models intended for fabrication, designers need to trade-off the aesthetic qualities of a 3D model with their intended physical properties. To be functional post-fabrication, 3D models have to satisfy structural constraints informed by physical principles. Currently, such requirements are not enforced by generative AI tools. This leads to the development of aesthetically appealing, but potentially non-functional 3D geometry, that would be hard to fabricate and use in the real world. This workshop paper highlights the limitations of generative AI tools in translating digital creations into the physical world and proposes new augmentations to generative AI tools for creating physically viable 3D models. We advocate for the development of tools that manipulate or generate 3D models by considering not only the aesthetic appearance but also using physical properties as constraints. This exploration seeks to bridge the gap between digital creativity and real-world applicability, extending the creative potential of generative AI into the tangible domain.
title Shaping Realities: Enhancing 3D Generative AI with Fabrication Constraints
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2404.10142