Prototyping with Prompts: Emerging Approaches and Challenges in Generative AI Design for Collaborative Software Teams
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913764705566720 |
|---|---|
| author | Subramonyam, Hari Thakkar, Divy Ku, Andrew Dieber, Jürgen Sinha, Anoop |
| author_facet | Subramonyam, Hari Thakkar, Divy Ku, Andrew Dieber, Jürgen Sinha, Anoop |
| contents | Generative AI models are increasingly being integrated into human task workflows, enabling the production of expressive content across a wide range of contexts. Unlike traditional human-AI design methods, the new approach to designing generative capabilities focuses heavily on prompt engineering strategies. This shift requires a deeper understanding of how collaborative software teams establish and apply design guidelines, iteratively prototype prompts, and evaluate them to achieve specific outcomes. To explore these dynamics, we conducted design studies with 39 industry professionals, including UX designers, AI engineers, and product managers. Our findings highlight emerging practices and role shifts in AI system prototyping among multistakeholder teams. We observe various prompting and prototyping strategies, highlighting the pivotal role of to-be-generated content characteristics in enabling rapid, iterative prototyping with generative AI. By identifying associated challenges, such as the limited model interpretability and overfitting the design to specific example content, we outline considerations for generative AI prototyping. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_17721 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Prototyping with Prompts: Emerging Approaches and Challenges in Generative AI Design for Collaborative Software Teams Subramonyam, Hari Thakkar, Divy Ku, Andrew Dieber, Jürgen Sinha, Anoop Human-Computer Interaction Software Engineering Generative AI models are increasingly being integrated into human task workflows, enabling the production of expressive content across a wide range of contexts. Unlike traditional human-AI design methods, the new approach to designing generative capabilities focuses heavily on prompt engineering strategies. This shift requires a deeper understanding of how collaborative software teams establish and apply design guidelines, iteratively prototype prompts, and evaluate them to achieve specific outcomes. To explore these dynamics, we conducted design studies with 39 industry professionals, including UX designers, AI engineers, and product managers. Our findings highlight emerging practices and role shifts in AI system prototyping among multistakeholder teams. We observe various prompting and prototyping strategies, highlighting the pivotal role of to-be-generated content characteristics in enabling rapid, iterative prototyping with generative AI. By identifying associated challenges, such as the limited model interpretability and overfitting the design to specific example content, we outline considerations for generative AI prototyping. |
| title | Prototyping with Prompts: Emerging Approaches and Challenges in Generative AI Design for Collaborative Software Teams |
| topic | Human-Computer Interaction Software Engineering |
| url | https://arxiv.org/abs/2402.17721 |