Do Large Language Models Adapt to Language Variation across Socioeconomic Status?

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Bassignana, Elisa, Zhang, Mike, Hovy, Dirk, Curry, Amanda Cercas
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910020479746048
author Bassignana, Elisa
Zhang, Mike
Hovy, Dirk
Curry, Amanda Cercas
author_facet Bassignana, Elisa
Zhang, Mike
Hovy, Dirk
Curry, Amanda Cercas
contents Humans adjust their linguistic style to the audience they are addressing. However, the extent to which LLMs adapt to different social contexts is largely unknown. As these models increasingly mediate human-to-human communication, their failure to adapt to diverse styles can perpetuate stereotypes and marginalize communities whose linguistic norms are less closely mirrored by the models, thereby reinforcing social stratification. We study the extent to which LLMs integrate into social media communication across different socioeconomic status (SES) communities. We collect a novel dataset from Reddit and YouTube, stratified by SES. We prompt four LLMs with incomplete text from that corpus and compare the LLM-generated completions to the originals along 94 sociolinguistic metrics, including syntactic, rhetorical, and lexical features. LLMs modulate their style with respect to SES to only a minor extent, often resulting in approximation or caricature, and tend to emulate the style of upper SES more effectively. Our findings (1) show how LLMs risk amplifying linguistic hierarchies and (2) call into question their validity for agent-based social simulation, survey experiments, and any research relying on language style as a social signal.
format Preprint
id arxiv_https___arxiv_org_abs_2602_11939
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Do Large Language Models Adapt to Language Variation across Socioeconomic Status?
Bassignana, Elisa
Zhang, Mike
Hovy, Dirk
Curry, Amanda Cercas
Computation and Language
Humans adjust their linguistic style to the audience they are addressing. However, the extent to which LLMs adapt to different social contexts is largely unknown. As these models increasingly mediate human-to-human communication, their failure to adapt to diverse styles can perpetuate stereotypes and marginalize communities whose linguistic norms are less closely mirrored by the models, thereby reinforcing social stratification. We study the extent to which LLMs integrate into social media communication across different socioeconomic status (SES) communities. We collect a novel dataset from Reddit and YouTube, stratified by SES. We prompt four LLMs with incomplete text from that corpus and compare the LLM-generated completions to the originals along 94 sociolinguistic metrics, including syntactic, rhetorical, and lexical features. LLMs modulate their style with respect to SES to only a minor extent, often resulting in approximation or caricature, and tend to emulate the style of upper SES more effectively. Our findings (1) show how LLMs risk amplifying linguistic hierarchies and (2) call into question their validity for agent-based social simulation, survey experiments, and any research relying on language style as a social signal.
title Do Large Language Models Adapt to Language Variation across Socioeconomic Status?
topic Computation and Language
url https://arxiv.org/abs/2602.11939