One Persona, Many Cues, Different Results: How Sociodemographic Cues Impact LLM Personalization
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866911620797562880 |
|---|---|
| author | Weeber, Franziska Neplenbroek, Vera Batzner, Jan Padó, Sebastian |
| author_facet | Weeber, Franziska Neplenbroek, Vera Batzner, Jan Padó, Sebastian |
| contents | Personalization of LLMs by sociodemographic subgroup often improves user experience, but can also introduce or amplify biases and unfair outcomes across groups. Prior work has employed so-called personas, sociodemographic user attributes conveyed to a model, to study bias in LLMs by relying on a single cue to prompt a persona, such as user names or explicit attribute mentions. This disregards LLM sensitivity to prompt variation and the rarity of some cues in real interactions (external validity). We compare six commonly used persona cues across seven open and proprietary LLMs on four writing and advice tasks. While cues are overall highly correlated, they produce substantial variance in responses across personas that can change findings on persona-induced differences and bias. We therefore caution against claims based on single persona cues, especially when they are overly explicit and have low external validity. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_18572 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | One Persona, Many Cues, Different Results: How Sociodemographic Cues Impact LLM Personalization Weeber, Franziska Neplenbroek, Vera Batzner, Jan Padó, Sebastian Computation and Language Personalization of LLMs by sociodemographic subgroup often improves user experience, but can also introduce or amplify biases and unfair outcomes across groups. Prior work has employed so-called personas, sociodemographic user attributes conveyed to a model, to study bias in LLMs by relying on a single cue to prompt a persona, such as user names or explicit attribute mentions. This disregards LLM sensitivity to prompt variation and the rarity of some cues in real interactions (external validity). We compare six commonly used persona cues across seven open and proprietary LLMs on four writing and advice tasks. While cues are overall highly correlated, they produce substantial variance in responses across personas that can change findings on persona-induced differences and bias. We therefore caution against claims based on single persona cues, especially when they are overly explicit and have low external validity. |
| title | One Persona, Many Cues, Different Results: How Sociodemographic Cues Impact LLM Personalization |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2601.18572 |