Exploring Visual Prompts: Refining Images with Scribbles and Annotations in Generative AI Image Tools

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Park, Hyerim, Eiband, Malin, Luckow, Andre, Sedlmair, Michael
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912315599749120
author Park, Hyerim
Eiband, Malin
Luckow, Andre
Sedlmair, Michael
author_facet Park, Hyerim
Eiband, Malin
Luckow, Andre
Sedlmair, Michael
contents Generative AI (GenAI) tools are increasingly integrated into design workflows. While text prompts remain the primary input method for GenAI image tools, designers often struggle to craft effective ones. Moreover, research has primarily focused on input methods for ideation, with limited attention to refinement tasks. This study explores designers' preferences for three input methods - text prompts, annotations, and scribbles - through a preliminary digital paper-based study with seven professional designers. Designers preferred annotations for spatial adjustments and referencing in-image elements, while scribbles were favored for specifying attributes such as shape, size, and position, often combined with other methods. Text prompts excelled at providing detailed descriptions or when designers sought greater GenAI creativity. However, designers expressed concerns about AI misinterpreting annotations and scribbles and the effort needed to create effective text prompts. These insights inform GenAI interface design to better support refinement tasks, align with workflows, and enhance communication with AI systems.
format Preprint
id arxiv_https___arxiv_org_abs_2503_03398
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Exploring Visual Prompts: Refining Images with Scribbles and Annotations in Generative AI Image Tools
Park, Hyerim
Eiband, Malin
Luckow, Andre
Sedlmair, Michael
Human-Computer Interaction
Generative AI (GenAI) tools are increasingly integrated into design workflows. While text prompts remain the primary input method for GenAI image tools, designers often struggle to craft effective ones. Moreover, research has primarily focused on input methods for ideation, with limited attention to refinement tasks. This study explores designers' preferences for three input methods - text prompts, annotations, and scribbles - through a preliminary digital paper-based study with seven professional designers. Designers preferred annotations for spatial adjustments and referencing in-image elements, while scribbles were favored for specifying attributes such as shape, size, and position, often combined with other methods. Text prompts excelled at providing detailed descriptions or when designers sought greater GenAI creativity. However, designers expressed concerns about AI misinterpreting annotations and scribbles and the effort needed to create effective text prompts. These insights inform GenAI interface design to better support refinement tasks, align with workflows, and enhance communication with AI systems.
title Exploring Visual Prompts: Refining Images with Scribbles and Annotations in Generative AI Image Tools
topic Human-Computer Interaction
url https://arxiv.org/abs/2503.03398