MKG-Rank: Enhancing Large Language Models with Knowledge Graph for Multilingual Medical Question Answering

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Li, Feiyang, Chen, Yingjian, Liu, Haoran, Yang, Rui, Yuan, Han, Jiang, Yuang, Li, Tianxiao, Taylor, Edison Marrese, Rouhizadeh, Hossein, Iwasawa, Yusuke, Teodoro, Douglas, Matsuo, Yutaka, Li, Irene
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909546899832832
author Li, Feiyang
Chen, Yingjian
Liu, Haoran
Yang, Rui
Yuan, Han
Jiang, Yuang
Li, Tianxiao
Taylor, Edison Marrese
Rouhizadeh, Hossein
Iwasawa, Yusuke
Teodoro, Douglas
Matsuo, Yutaka
Li, Irene
author_facet Li, Feiyang
Chen, Yingjian
Liu, Haoran
Yang, Rui
Yuan, Han
Jiang, Yuang
Li, Tianxiao
Taylor, Edison Marrese
Rouhizadeh, Hossein
Iwasawa, Yusuke
Teodoro, Douglas
Matsuo, Yutaka
Li, Irene
contents Large Language Models (LLMs) have shown remarkable progress in medical question answering (QA), yet their effectiveness remains predominantly limited to English due to imbalanced multilingual training data and scarce medical resources for low-resource languages. To address this critical language gap in medical QA, we propose Multilingual Knowledge Graph-based Retrieval Ranking (MKG-Rank), a knowledge graph-enhanced framework that enables English-centric LLMs to perform multilingual medical QA. Through a word-level translation mechanism, our framework efficiently integrates comprehensive English-centric medical knowledge graphs into LLM reasoning at a low cost, mitigating cross-lingual semantic distortion and achieving precise medical QA across language barriers. To enhance efficiency, we introduce caching and multi-angle ranking strategies to optimize the retrieval process, significantly reducing response times and prioritizing relevant medical knowledge. Extensive evaluations on multilingual medical QA benchmarks across Chinese, Japanese, Korean, and Swahili demonstrate that MKG-Rank consistently outperforms zero-shot LLMs, achieving maximum 35.03% increase in accuracy, while maintaining an average retrieval time of only 0.0009 seconds.
format Preprint
id arxiv_https___arxiv_org_abs_2503_16131
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MKG-Rank: Enhancing Large Language Models with Knowledge Graph for Multilingual Medical Question Answering
Li, Feiyang
Chen, Yingjian
Liu, Haoran
Yang, Rui
Yuan, Han
Jiang, Yuang
Li, Tianxiao
Taylor, Edison Marrese
Rouhizadeh, Hossein
Iwasawa, Yusuke
Teodoro, Douglas
Matsuo, Yutaka
Li, Irene
Computation and Language
Large Language Models (LLMs) have shown remarkable progress in medical question answering (QA), yet their effectiveness remains predominantly limited to English due to imbalanced multilingual training data and scarce medical resources for low-resource languages. To address this critical language gap in medical QA, we propose Multilingual Knowledge Graph-based Retrieval Ranking (MKG-Rank), a knowledge graph-enhanced framework that enables English-centric LLMs to perform multilingual medical QA. Through a word-level translation mechanism, our framework efficiently integrates comprehensive English-centric medical knowledge graphs into LLM reasoning at a low cost, mitigating cross-lingual semantic distortion and achieving precise medical QA across language barriers. To enhance efficiency, we introduce caching and multi-angle ranking strategies to optimize the retrieval process, significantly reducing response times and prioritizing relevant medical knowledge. Extensive evaluations on multilingual medical QA benchmarks across Chinese, Japanese, Korean, and Swahili demonstrate that MKG-Rank consistently outperforms zero-shot LLMs, achieving maximum 35.03% increase in accuracy, while maintaining an average retrieval time of only 0.0009 seconds.
title MKG-Rank: Enhancing Large Language Models with Knowledge Graph for Multilingual Medical Question Answering
topic Computation and Language
url https://arxiv.org/abs/2503.16131