1+1>2: Can Large Language Models Serve as Cross-Lingual Knowledge Aggregators?
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909228753485824 |
|---|---|
| author | Huang, Yue Fan, Chenrui Li, Yuan Wu, Siyuan Zhou, Tianyi Zhang, Xiangliang Sun, Lichao |
| author_facet | Huang, Yue Fan, Chenrui Li, Yuan Wu, Siyuan Zhou, Tianyi Zhang, Xiangliang Sun, Lichao |
| contents | Large Language Models (LLMs) have garnered significant attention due to their remarkable ability to process information across various languages. Despite their capabilities, they exhibit inconsistencies in handling identical queries in different languages, presenting challenges for further advancement. This paper introduces a method to enhance the multilingual performance of LLMs by aggregating knowledge from diverse languages. This approach incorporates a low-resource knowledge detector specific to a language, a language selection process, and mechanisms for answer replacement and integration. Our experiments demonstrate notable performance improvements, particularly in reducing language performance disparity. An ablation study confirms that each component of our method significantly contributes to these enhancements. This research highlights the inherent potential of LLMs to harmonize multilingual capabilities and offers valuable insights for further exploration. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_14721 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | 1+1>2: Can Large Language Models Serve as Cross-Lingual Knowledge Aggregators? Huang, Yue Fan, Chenrui Li, Yuan Wu, Siyuan Zhou, Tianyi Zhang, Xiangliang Sun, Lichao Computation and Language Large Language Models (LLMs) have garnered significant attention due to their remarkable ability to process information across various languages. Despite their capabilities, they exhibit inconsistencies in handling identical queries in different languages, presenting challenges for further advancement. This paper introduces a method to enhance the multilingual performance of LLMs by aggregating knowledge from diverse languages. This approach incorporates a low-resource knowledge detector specific to a language, a language selection process, and mechanisms for answer replacement and integration. Our experiments demonstrate notable performance improvements, particularly in reducing language performance disparity. An ablation study confirms that each component of our method significantly contributes to these enhancements. This research highlights the inherent potential of LLMs to harmonize multilingual capabilities and offers valuable insights for further exploration. |
| title | 1+1>2: Can Large Language Models Serve as Cross-Lingual Knowledge Aggregators? |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2406.14721 |