Exploring Creativity in Human-Human-LLM Collaborative Software Design

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Jackson, Victoria, Liebel, Grischa, Prikladnicki, Rafael, van der Hoek, Andre
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914510425554944
author Jackson, Victoria
Liebel, Grischa
Prikladnicki, Rafael
van der Hoek, Andre
author_facet Jackson, Victoria
Liebel, Grischa
Prikladnicki, Rafael
van der Hoek, Andre
contents While the use of Large Language Models (LLMs) in programming has been extensively studied, there is limited understanding of how LLMs support collaborative work where creativity plays a central role. Software design, as a collaborative and creative activity, provides a valuable context for exploring the influence of LLMs on creativity. This study investigates how and where creativity naturally emerges when software designers collaborate with an LLM during a design task. In a laboratory setting simulating a workplace environment, 18 pairs of software professionals with design experience were asked to complete a design task. Each pair had 90 minutes to produce a software design based on a set of requirements, with optional access to a custom LLM interface. Pairs were not primed to be creative. We find that creativity was present in all pairs in design processes, with 13 producing design documents containing creativity. We primarily attribute creativity to the human designers, driven by traits such as prior experience, empathy, and the use of analogies. The LLM contributed by producing novel ideas and elaborating human ideas. However, in some cases, the LLM appeared to hinder creativity by suggesting complex solutions or adding to unproductive digressions. LLMs can support creativity in collaborative software design, but human insights remain central. To effectively augment human creativity, designers must be intentional in their engagement with LLMs.
format Preprint
id arxiv_https___arxiv_org_abs_2604_24373
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Exploring Creativity in Human-Human-LLM Collaborative Software Design
Jackson, Victoria
Liebel, Grischa
Prikladnicki, Rafael
van der Hoek, Andre
Software Engineering
While the use of Large Language Models (LLMs) in programming has been extensively studied, there is limited understanding of how LLMs support collaborative work where creativity plays a central role. Software design, as a collaborative and creative activity, provides a valuable context for exploring the influence of LLMs on creativity. This study investigates how and where creativity naturally emerges when software designers collaborate with an LLM during a design task. In a laboratory setting simulating a workplace environment, 18 pairs of software professionals with design experience were asked to complete a design task. Each pair had 90 minutes to produce a software design based on a set of requirements, with optional access to a custom LLM interface. Pairs were not primed to be creative. We find that creativity was present in all pairs in design processes, with 13 producing design documents containing creativity. We primarily attribute creativity to the human designers, driven by traits such as prior experience, empathy, and the use of analogies. The LLM contributed by producing novel ideas and elaborating human ideas. However, in some cases, the LLM appeared to hinder creativity by suggesting complex solutions or adding to unproductive digressions. LLMs can support creativity in collaborative software design, but human insights remain central. To effectively augment human creativity, designers must be intentional in their engagement with LLMs.
title Exploring Creativity in Human-Human-LLM Collaborative Software Design
topic Software Engineering
url https://arxiv.org/abs/2604.24373