Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2506.10491 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909762240643072 |
|---|---|
| author | Sorokovikova, Aleksandra Chizhov, Pavel Eremenko, Iuliia Yamshchikov, Ivan P. |
| author_facet | Sorokovikova, Aleksandra Chizhov, Pavel Eremenko, Iuliia Yamshchikov, Ivan P. |
| contents | Modern language models are trained on large amounts of data. These data inevitably include controversial and stereotypical content, which contains all sorts of biases related to gender, origin, age, etc. As a result, the models express biased points of view or produce different results based on the assigned personality or the personality of the user. In this paper, we investigate various proxy measures of bias in large language models (LLMs). We find that evaluating models with pre-prompted personae on a multi-subject benchmark (MMLU) leads to negligible and mostly random differences in scores. However, if we reformulate the task and ask a model to grade the user's answer, this shows more significant signs of bias. Finally, if we ask the model for salary negotiation advice, we see pronounced bias in the answers. With the recent trend for LLM assistant memory and personalization, these problems open up from a different angle: modern LLM users do not need to pre-prompt the description of their persona since the model already knows their socio-demographics. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_10491 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Surface Fairness, Deep Bias: A Comparative Study of Bias in Language Models Sorokovikova, Aleksandra Chizhov, Pavel Eremenko, Iuliia Yamshchikov, Ivan P. Computation and Language Modern language models are trained on large amounts of data. These data inevitably include controversial and stereotypical content, which contains all sorts of biases related to gender, origin, age, etc. As a result, the models express biased points of view or produce different results based on the assigned personality or the personality of the user. In this paper, we investigate various proxy measures of bias in large language models (LLMs). We find that evaluating models with pre-prompted personae on a multi-subject benchmark (MMLU) leads to negligible and mostly random differences in scores. However, if we reformulate the task and ask a model to grade the user's answer, this shows more significant signs of bias. Finally, if we ask the model for salary negotiation advice, we see pronounced bias in the answers. With the recent trend for LLM assistant memory and personalization, these problems open up from a different angle: modern LLM users do not need to pre-prompt the description of their persona since the model already knows their socio-demographics. |
| title | Surface Fairness, Deep Bias: A Comparative Study of Bias in Language Models |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2506.10491 |