Sketch2Prototype: Rapid Conceptual Design Exploration and Prototyping with Generative AI
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916255101878272 |
|---|---|
| author | Edwards, Kristen M. Man, Brandon Ahmed, Faez |
| author_facet | Edwards, Kristen M. Man, Brandon Ahmed, Faez |
| contents | Sketch2Prototype is an AI-based framework that transforms a hand-drawn sketch into a diverse set of 2D images and 3D prototypes through sketch-to-text, text-to-image, and image-to-3D stages. This framework, shown across various sketches, rapidly generates text, image, and 3D modalities for enhanced early-stage design exploration. We show that using text as an intermediate modality outperforms direct sketch-to-3D baselines for generating diverse and manufacturable 3D models. We find limitations in current image-to-3D techniques, while noting the value of the text modality for user-feedback and iterative design augmentation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_12985 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Sketch2Prototype: Rapid Conceptual Design Exploration and Prototyping with Generative AI Edwards, Kristen M. Man, Brandon Ahmed, Faez Human-Computer Interaction Artificial Intelligence Computer Vision and Pattern Recognition Sketch2Prototype is an AI-based framework that transforms a hand-drawn sketch into a diverse set of 2D images and 3D prototypes through sketch-to-text, text-to-image, and image-to-3D stages. This framework, shown across various sketches, rapidly generates text, image, and 3D modalities for enhanced early-stage design exploration. We show that using text as an intermediate modality outperforms direct sketch-to-3D baselines for generating diverse and manufacturable 3D models. We find limitations in current image-to-3D techniques, while noting the value of the text modality for user-feedback and iterative design augmentation. |
| title | Sketch2Prototype: Rapid Conceptual Design Exploration and Prototyping with Generative AI |
| topic | Human-Computer Interaction Artificial Intelligence Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2405.12985 |