A Survey on Large Language Models with Multilingualism: Recent Advances and New Frontiers
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909450190716928 |
|---|---|
| author | Huang, Kaiyu Mo, Fengran Zhang, Xinyu Li, Hongliang Li, You Zhang, Yuanchi Yi, Weijian Mao, Yulong Liu, Jinchen Xu, Yuzhuang Xu, Jinan Nie, Jian-Yun Liu, Yang |
| author_facet | Huang, Kaiyu Mo, Fengran Zhang, Xinyu Li, Hongliang Li, You Zhang, Yuanchi Yi, Weijian Mao, Yulong Liu, Jinchen Xu, Yuzhuang Xu, Jinan Nie, Jian-Yun Liu, Yang |
| contents | The rapid development of Large Language Models (LLMs) demonstrates remarkable multilingual capabilities in natural language processing, attracting global attention in both academia and industry. To mitigate potential discrimination and enhance the overall usability and accessibility for diverse language user groups, it is important for the development of language-fair technology. Despite the breakthroughs of LLMs, the investigation into the multilingual scenario remains insufficient, where a comprehensive survey to summarize recent approaches, developments, limitations, and potential solutions is desirable. To this end, we provide a survey with multiple perspectives on the utilization of LLMs in the multilingual scenario. We first rethink the transitions between previous and current research on pre-trained language models. Then we introduce several perspectives on the multilingualism of LLMs, including training and inference methods, information retrieval, model security, multi-domain with language culture, and usage of datasets. We also discuss the major challenges that arise in these aspects, along with possible solutions. Besides, we highlight future research directions that aim at further enhancing LLMs with multilingualism. The survey aims to help the research community address multilingual problems and provide a comprehensive understanding of the core concepts, key techniques, and latest developments in multilingual natural language processing based on LLMs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_10936 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Survey on Large Language Models with Multilingualism: Recent Advances and New Frontiers Huang, Kaiyu Mo, Fengran Zhang, Xinyu Li, Hongliang Li, You Zhang, Yuanchi Yi, Weijian Mao, Yulong Liu, Jinchen Xu, Yuzhuang Xu, Jinan Nie, Jian-Yun Liu, Yang Computation and Language Artificial Intelligence The rapid development of Large Language Models (LLMs) demonstrates remarkable multilingual capabilities in natural language processing, attracting global attention in both academia and industry. To mitigate potential discrimination and enhance the overall usability and accessibility for diverse language user groups, it is important for the development of language-fair technology. Despite the breakthroughs of LLMs, the investigation into the multilingual scenario remains insufficient, where a comprehensive survey to summarize recent approaches, developments, limitations, and potential solutions is desirable. To this end, we provide a survey with multiple perspectives on the utilization of LLMs in the multilingual scenario. We first rethink the transitions between previous and current research on pre-trained language models. Then we introduce several perspectives on the multilingualism of LLMs, including training and inference methods, information retrieval, model security, multi-domain with language culture, and usage of datasets. We also discuss the major challenges that arise in these aspects, along with possible solutions. Besides, we highlight future research directions that aim at further enhancing LLMs with multilingualism. The survey aims to help the research community address multilingual problems and provide a comprehensive understanding of the core concepts, key techniques, and latest developments in multilingual natural language processing based on LLMs. |
| title | A Survey on Large Language Models with Multilingualism: Recent Advances and New Frontiers |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2405.10936 |