Who Controls the Conversation? User Perspectives On Generative AI (LLM) System Prompts

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Neumann, Anna, Pi, Yulu, Singh, Jatinder
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914358526738432
author Neumann, Anna
Pi, Yulu
Singh, Jatinder
author_facet Neumann, Anna
Pi, Yulu
Singh, Jatinder
contents System prompts - instructions that shape the behaviour of generative AI systems - strongly influence system outputs and users' experiences. They define the model's guidelines, `personality', and guardrails, taking precedence over user inputs. Despite their influence, transparency is limited: system prompts are generally not made public and most platforms instruct models to conceal them, leaving users disconnected from and unaware of a key mechanism guiding and governing their AI interactions. This paper argues that system prompts warrant explicit, user-centred design attention and, focusing on large language models (LLMs), asks: what do system prompts contain, how do end-users perceive them, and what do these perceptions offer for design and governance practice? Our results reveal user perspectives on: the benefits and risks of system prompts; the values they prefer to be associated with prompt-design; their levels of comfort with different types of prompts; and degrees of transparency and user control regarding prompt content. From these findings emerge considerations for how designers can better align system prompt mechanisms with user expectations and preferences over these mechanisms that directly shape how generative AI systems behave.
format Preprint
id arxiv_https___arxiv_org_abs_2603_00089
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Who Controls the Conversation? User Perspectives On Generative AI (LLM) System Prompts
Neumann, Anna
Pi, Yulu
Singh, Jatinder
Computers and Society
System prompts - instructions that shape the behaviour of generative AI systems - strongly influence system outputs and users' experiences. They define the model's guidelines, `personality', and guardrails, taking precedence over user inputs. Despite their influence, transparency is limited: system prompts are generally not made public and most platforms instruct models to conceal them, leaving users disconnected from and unaware of a key mechanism guiding and governing their AI interactions. This paper argues that system prompts warrant explicit, user-centred design attention and, focusing on large language models (LLMs), asks: what do system prompts contain, how do end-users perceive them, and what do these perceptions offer for design and governance practice? Our results reveal user perspectives on: the benefits and risks of system prompts; the values they prefer to be associated with prompt-design; their levels of comfort with different types of prompts; and degrees of transparency and user control regarding prompt content. From these findings emerge considerations for how designers can better align system prompt mechanisms with user expectations and preferences over these mechanisms that directly shape how generative AI systems behave.
title Who Controls the Conversation? User Perspectives On Generative AI (LLM) System Prompts
topic Computers and Society
url https://arxiv.org/abs/2603.00089