Adapting Psycholinguistic Research for LLMs: Gender-inclusive Language in a Coreference Context

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Bartl, Marion, Murphy, Thomas Brendan, Leavy, Susan
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913696970702848
author Bartl, Marion
Murphy, Thomas Brendan
Leavy, Susan
author_facet Bartl, Marion
Murphy, Thomas Brendan
Leavy, Susan
contents Gender-inclusive language is often used with the aim of ensuring that all individuals, regardless of gender, can be associated with certain concepts. While psycholinguistic studies have examined its effects in relation to human cognition, it remains unclear how Large Language Models (LLMs) process gender-inclusive language. Given that commercial LLMs are gaining an increasingly strong foothold in everyday applications, it is crucial to examine whether LLMs in fact interpret gender-inclusive language neutrally, because the language they generate has the potential to influence the language of their users. This study examines whether LLM-generated coreferent terms align with a given gender expression or reflect model biases. Adapting psycholinguistic methods from French to English and German, we find that in English, LLMs generally maintain the antecedent's gender but exhibit underlying masculine bias. In German, this bias is much stronger, overriding all tested gender-neutralization strategies.
format Preprint
id arxiv_https___arxiv_org_abs_2502_13120
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Adapting Psycholinguistic Research for LLMs: Gender-inclusive Language in a Coreference Context
Bartl, Marion
Murphy, Thomas Brendan
Leavy, Susan
Computation and Language
Artificial Intelligence
Gender-inclusive language is often used with the aim of ensuring that all individuals, regardless of gender, can be associated with certain concepts. While psycholinguistic studies have examined its effects in relation to human cognition, it remains unclear how Large Language Models (LLMs) process gender-inclusive language. Given that commercial LLMs are gaining an increasingly strong foothold in everyday applications, it is crucial to examine whether LLMs in fact interpret gender-inclusive language neutrally, because the language they generate has the potential to influence the language of their users. This study examines whether LLM-generated coreferent terms align with a given gender expression or reflect model biases. Adapting psycholinguistic methods from French to English and German, we find that in English, LLMs generally maintain the antecedent's gender but exhibit underlying masculine bias. In German, this bias is much stronger, overriding all tested gender-neutralization strategies.
title Adapting Psycholinguistic Research for LLMs: Gender-inclusive Language in a Coreference Context
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2502.13120