Prompting for Discovery: Flexible Sense-Making for AI Art-Making with Dreamsheets
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2023
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866916143270199296 |
|---|---|
| author | Almeda, Shm Garanganao Zamfirescu-Pereira, J. D. Kim, Kyu Won Rathnam, Pradeep Mani Hartmann, Bjoern |
| author_facet | Almeda, Shm Garanganao Zamfirescu-Pereira, J. D. Kim, Kyu Won Rathnam, Pradeep Mani Hartmann, Bjoern |
| contents | Design space exploration (DSE) for Text-to-Image (TTI) models entails navigating a vast, opaque space of possible image outputs, through a commensurately vast input space of hyperparameters and prompt text. Minor adjustments to prompt input can surface unexpectedly disparate images. How can interfaces support end-users in reliably steering prompt-space explorations towards interesting results? Our design probe, DreamSheets, supports exploration strategies with LLM-based functions for assisted prompt construction and simultaneous display of generated results, hosted in a spreadsheet interface. The flexible layout and novel generative functions enable experimentation with user-defined workflows. Two studies, a preliminary lab study and a longitudinal study with five expert artists, revealed a set of strategies participants use to tackle the challenges of TTI design space exploration, and the interface features required to support them - like using text-generation to define local "axes" of exploration. We distill these insights into a UI mockup to guide future interfaces. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2310_09985 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Prompting for Discovery: Flexible Sense-Making for AI Art-Making with Dreamsheets Almeda, Shm Garanganao Zamfirescu-Pereira, J. D. Kim, Kyu Won Rathnam, Pradeep Mani Hartmann, Bjoern Human-Computer Interaction Design space exploration (DSE) for Text-to-Image (TTI) models entails navigating a vast, opaque space of possible image outputs, through a commensurately vast input space of hyperparameters and prompt text. Minor adjustments to prompt input can surface unexpectedly disparate images. How can interfaces support end-users in reliably steering prompt-space explorations towards interesting results? Our design probe, DreamSheets, supports exploration strategies with LLM-based functions for assisted prompt construction and simultaneous display of generated results, hosted in a spreadsheet interface. The flexible layout and novel generative functions enable experimentation with user-defined workflows. Two studies, a preliminary lab study and a longitudinal study with five expert artists, revealed a set of strategies participants use to tackle the challenges of TTI design space exploration, and the interface features required to support them - like using text-generation to define local "axes" of exploration. We distill these insights into a UI mockup to guide future interfaces. |
| title | Prompting for Discovery: Flexible Sense-Making for AI Art-Making with Dreamsheets |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2310.09985 |