AI-Augmented Brainwriting: Investigating the use of LLMs in group ideation
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917601153646592 |
|---|---|
| author | Shaer, Orit Cooper, Angelora Mokryn, Osnat Kun, Andrew L. Shoshan, Hagit Ben |
| author_facet | Shaer, Orit Cooper, Angelora Mokryn, Osnat Kun, Andrew L. Shoshan, Hagit Ben |
| contents | The growing availability of generative AI technologies such as large language models (LLMs) has significant implications for creative work. This paper explores twofold aspects of integrating LLMs into the creative process - the divergence stage of idea generation, and the convergence stage of evaluation and selection of ideas. We devised a collaborative group-AI Brainwriting ideation framework, which incorporated an LLM as an enhancement into the group ideation process, and evaluated the idea generation process and the resulted solution space. To assess the potential of using LLMs in the idea evaluation process, we design an evaluation engine and compared it to idea ratings assigned by three expert and six novice evaluators. Our findings suggest that integrating LLM in Brainwriting could enhance both the ideation process and its outcome. We also provide evidence that LLMs can support idea evaluation. We conclude by discussing implications for HCI education and practice. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_14978 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | AI-Augmented Brainwriting: Investigating the use of LLMs in group ideation Shaer, Orit Cooper, Angelora Mokryn, Osnat Kun, Andrew L. Shoshan, Hagit Ben Human-Computer Interaction Artificial Intelligence Computers and Society H.5.2; J.4 The growing availability of generative AI technologies such as large language models (LLMs) has significant implications for creative work. This paper explores twofold aspects of integrating LLMs into the creative process - the divergence stage of idea generation, and the convergence stage of evaluation and selection of ideas. We devised a collaborative group-AI Brainwriting ideation framework, which incorporated an LLM as an enhancement into the group ideation process, and evaluated the idea generation process and the resulted solution space. To assess the potential of using LLMs in the idea evaluation process, we design an evaluation engine and compared it to idea ratings assigned by three expert and six novice evaluators. Our findings suggest that integrating LLM in Brainwriting could enhance both the ideation process and its outcome. We also provide evidence that LLMs can support idea evaluation. We conclude by discussing implications for HCI education and practice. |
| title | AI-Augmented Brainwriting: Investigating the use of LLMs in group ideation |
| topic | Human-Computer Interaction Artificial Intelligence Computers and Society H.5.2; J.4 |
| url | https://arxiv.org/abs/2402.14978 |