Effects of Cross-lingual Evidence in Multilingual Medical Question Answering

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yeginbergen, Anar, Oronoz, Maite, Agerri, Rodrigo
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911614815436800
author Yeginbergen, Anar
Oronoz, Maite
Agerri, Rodrigo
author_facet Yeginbergen, Anar
Oronoz, Maite
Agerri, Rodrigo
contents This paper investigates Multilingual Medical Question Answering across high-resource (English, Spanish, French, Italian) and low-resource (Basque, Kazakh) languages. We evaluate three types of external evidence sources across models of varying size: curated repositories of specialized medical knowledge, web-retrieved content, and explanations from LLM's parametric knowledge. Moreover, we conduct experiments with multilingual, monolingual and cross-lingual retrieval. Our results demonstrate that larger models consistently achieve superior performance in English across baseline evaluations. When incorporating external knowledge, web-retrieved data in English proves most beneficial for high-resource languages. Conversely, for low-resource languages, the most effective strategy combines retrieval in both English and the target language, achieving comparable accuracy to high-resource language results. These findings challenge the assumption that external knowledge systematically improves performance and reveal that effective strategies depend on both the source of language resources and on model scale. Furthermore, specialized medical knowledge sources such as PubMed are limited: while they provide authoritative expert knowledge, they lack adequate multilingual coverage
format Preprint
id arxiv_https___arxiv_org_abs_2604_20531
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Effects of Cross-lingual Evidence in Multilingual Medical Question Answering
Yeginbergen, Anar
Oronoz, Maite
Agerri, Rodrigo
Computation and Language
This paper investigates Multilingual Medical Question Answering across high-resource (English, Spanish, French, Italian) and low-resource (Basque, Kazakh) languages. We evaluate three types of external evidence sources across models of varying size: curated repositories of specialized medical knowledge, web-retrieved content, and explanations from LLM's parametric knowledge. Moreover, we conduct experiments with multilingual, monolingual and cross-lingual retrieval. Our results demonstrate that larger models consistently achieve superior performance in English across baseline evaluations. When incorporating external knowledge, web-retrieved data in English proves most beneficial for high-resource languages. Conversely, for low-resource languages, the most effective strategy combines retrieval in both English and the target language, achieving comparable accuracy to high-resource language results. These findings challenge the assumption that external knowledge systematically improves performance and reveal that effective strategies depend on both the source of language resources and on model scale. Furthermore, specialized medical knowledge sources such as PubMed are limited: while they provide authoritative expert knowledge, they lack adequate multilingual coverage
title Effects of Cross-lingual Evidence in Multilingual Medical Question Answering
topic Computation and Language
url https://arxiv.org/abs/2604.20531