Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2507.16557 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916856310267904 |
|---|---|
| author | Gnadt, Kristin Thulke, David Kopeinik, Simone Schlüter, Ralf |
| author_facet | Gnadt, Kristin Thulke, David Kopeinik, Simone Schlüter, Ralf |
| contents | In recent years, various methods have been proposed to evaluate gender bias in large language models (LLMs). A key challenge lies in the transferability of bias measurement methods initially developed for the English language when applied to other languages. This work aims to contribute to this research strand by presenting five German datasets for gender bias evaluation in LLMs. The datasets are grounded in well-established concepts of gender bias and are accessible through multiple methodologies. Our findings, reported for eight multilingual LLM models, reveal unique challenges associated with gender bias in German, including the ambiguous interpretation of male occupational terms and the influence of seemingly neutral nouns on gender perception. This work contributes to the understanding of gender bias in LLMs across languages and underscores the necessity for tailored evaluation frameworks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_16557 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Exploring Gender Bias in Large Language Models: An In-depth Dive into the German Language Gnadt, Kristin Thulke, David Kopeinik, Simone Schlüter, Ralf Computation and Language Machine Learning In recent years, various methods have been proposed to evaluate gender bias in large language models (LLMs). A key challenge lies in the transferability of bias measurement methods initially developed for the English language when applied to other languages. This work aims to contribute to this research strand by presenting five German datasets for gender bias evaluation in LLMs. The datasets are grounded in well-established concepts of gender bias and are accessible through multiple methodologies. Our findings, reported for eight multilingual LLM models, reveal unique challenges associated with gender bias in German, including the ambiguous interpretation of male occupational terms and the influence of seemingly neutral nouns on gender perception. This work contributes to the understanding of gender bias in LLMs across languages and underscores the necessity for tailored evaluation frameworks. |
| title | Exploring Gender Bias in Large Language Models: An In-depth Dive into the German Language |
| topic | Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2507.16557 |