Presumed Cultural Identity: How Names Shape LLM Responses

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Pawar, Siddhesh, Arora, Arnav, Kaffee, Lucie-Aimée, Augenstein, Isabelle
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909532298412032
author Pawar, Siddhesh
Arora, Arnav
Kaffee, Lucie-Aimée
Augenstein, Isabelle
author_facet Pawar, Siddhesh
Arora, Arnav
Kaffee, Lucie-Aimée
Augenstein, Isabelle
contents Names are deeply tied to human identity. They can serve as markers of individuality, cultural heritage, and personal history. However, using names as a core indicator of identity can lead to over-simplification of complex identities. When interacting with LLMs, user names are an important point of information for personalisation. Names can enter chatbot conversations through direct user input (requested by chatbots), as part of task contexts such as CV reviews, or as built-in memory features that store user information for personalisation. We study biases associated with names by measuring cultural presumptions in the responses generated by LLMs when presented with common suggestion-seeking queries, which might involve making assumptions about the user. Our analyses demonstrate strong assumptions about cultural identity associated with names present in LLM generations across multiple cultures. Our work has implications for designing more nuanced personalisation systems that avoid reinforcing stereotypes while maintaining meaningful customisation.
format Preprint
id arxiv_https___arxiv_org_abs_2502_11995
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Presumed Cultural Identity: How Names Shape LLM Responses
Pawar, Siddhesh
Arora, Arnav
Kaffee, Lucie-Aimée
Augenstein, Isabelle
Computation and Language
Artificial Intelligence
I.2.7
Names are deeply tied to human identity. They can serve as markers of individuality, cultural heritage, and personal history. However, using names as a core indicator of identity can lead to over-simplification of complex identities. When interacting with LLMs, user names are an important point of information for personalisation. Names can enter chatbot conversations through direct user input (requested by chatbots), as part of task contexts such as CV reviews, or as built-in memory features that store user information for personalisation. We study biases associated with names by measuring cultural presumptions in the responses generated by LLMs when presented with common suggestion-seeking queries, which might involve making assumptions about the user. Our analyses demonstrate strong assumptions about cultural identity associated with names present in LLM generations across multiple cultures. Our work has implications for designing more nuanced personalisation systems that avoid reinforcing stereotypes while maintaining meaningful customisation.
title Presumed Cultural Identity: How Names Shape LLM Responses
topic Computation and Language
Artificial Intelligence
I.2.7
url https://arxiv.org/abs/2502.11995