Language Bias under Conflicting Information in Multilingual LLMs

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Östling, Robert, Kurfalı, Murathan
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914458252607488
author Östling, Robert
Kurfalı, Murathan
author_facet Östling, Robert
Kurfalı, Murathan
contents Large Language Models (LLMs) have been shown to contain biases in the process of integrating conflicting information when answering questions. Here we ask whether such biases also exist with respect to which language is used for each conflicting piece of information. To answer this question, we extend the conflicting needles in a haystack paradigm to a multilingual setting and perform a comprehensive set of evaluations with naturalistic news domain data in five different languages, for a range of multilingual LLMs of different sizes. We find that all LLMs tested, including GPT-5.2, ignore the conflict and confidently assert only one of the possible answers in the large majority of cases. Furthermore, there is a consistent bias across models in which languages are preferred, with a general bias against Russian and, for the longest context lengths, in favor of Chinese. Both of these patterns are consistent between models trained inside and outside of mainland China, though somewhat stronger in the former category.
format Preprint
id arxiv_https___arxiv_org_abs_2604_07123
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Language Bias under Conflicting Information in Multilingual LLMs
Östling, Robert
Kurfalı, Murathan
Computation and Language
Large Language Models (LLMs) have been shown to contain biases in the process of integrating conflicting information when answering questions. Here we ask whether such biases also exist with respect to which language is used for each conflicting piece of information. To answer this question, we extend the conflicting needles in a haystack paradigm to a multilingual setting and perform a comprehensive set of evaluations with naturalistic news domain data in five different languages, for a range of multilingual LLMs of different sizes. We find that all LLMs tested, including GPT-5.2, ignore the conflict and confidently assert only one of the possible answers in the large majority of cases. Furthermore, there is a consistent bias across models in which languages are preferred, with a general bias against Russian and, for the longest context lengths, in favor of Chinese. Both of these patterns are consistent between models trained inside and outside of mainland China, though somewhat stronger in the former category.
title Language Bias under Conflicting Information in Multilingual LLMs
topic Computation and Language
url https://arxiv.org/abs/2604.07123