Sports and Women's Sports: Gender Bias in Text Generation with Olympic Data

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autore principale: Biester, Laura
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929700915380224
author Biester, Laura
author_facet Biester, Laura
contents Large Language Models (LLMs) have been shown to be biased in prior work, as they generate text that is in line with stereotypical views of the world or that is not representative of the viewpoints and values of historically marginalized demographic groups. In this work, we propose using data from parallel men's and women's events at the Olympic Games to investigate different forms of gender bias in language models. We define three metrics to measure bias, and find that models are consistently biased against women when the gender is ambiguous in the prompt. In this case, the model frequently retrieves only the results of the men's event with or without acknowledging them as such, revealing pervasive gender bias in LLMs in the context of athletics.
format Preprint
id arxiv_https___arxiv_org_abs_2502_04218
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Sports and Women's Sports: Gender Bias in Text Generation with Olympic Data
Biester, Laura
Computation and Language
Large Language Models (LLMs) have been shown to be biased in prior work, as they generate text that is in line with stereotypical views of the world or that is not representative of the viewpoints and values of historically marginalized demographic groups. In this work, we propose using data from parallel men's and women's events at the Olympic Games to investigate different forms of gender bias in language models. We define three metrics to measure bias, and find that models are consistently biased against women when the gender is ambiguous in the prompt. In this case, the model frequently retrieves only the results of the men's event with or without acknowledging them as such, revealing pervasive gender bias in LLMs in the context of athletics.
title Sports and Women's Sports: Gender Bias in Text Generation with Olympic Data
topic Computation and Language
url https://arxiv.org/abs/2502.04218