Effective vocabulary expanding of multilingual language models for extremely low-resource languages
Fuente:
arXiv
Enregistré dans:
| Auteur principal: | Zheng, Jianyu |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
Documents similaires
InkubaLM: A small language model for low-resource African languages
par: Tonja, Atnafu Lambebo, et autres
Publié: (2024)
par: Tonja, Atnafu Lambebo, et autres
Publié: (2024)
EuroGEST: Investigating gender stereotypes in multilingual language models
par: Rowe, Jacqueline, et autres
Publié: (2025)
par: Rowe, Jacqueline, et autres
Publié: (2025)
Morphological evaluation of subwords vocabulary used by BETO language model
par: García-Sierra, Óscar, et autres
Publié: (2024)
par: García-Sierra, Óscar, et autres
Publié: (2024)
The Lucie-7B LLM and the Lucie Training Dataset: Open resources for multilingual language generation
par: Gouvert, Olivier, et autres
Publié: (2025)
par: Gouvert, Olivier, et autres
Publié: (2025)
One ruler to measure them all: Benchmarking multilingual long-context language models
par: Kim, Yekyung, et autres
Publié: (2025)
par: Kim, Yekyung, et autres
Publié: (2025)
Cross-lingual transfer of multilingual models on low resource African Languages
par: Thangaraj, Harish, et autres
Publié: (2024)
par: Thangaraj, Harish, et autres
Publié: (2024)
Are ASR foundation models generalized enough to capture features of regional dialects for low-resource languages?
par: Dipto, Tawsif Tashwar, et autres
Publié: (2025)
par: Dipto, Tawsif Tashwar, et autres
Publié: (2025)
Phonetically rich corpus construction for a low-resourced language
par: Amadeus, Marcellus, et autres
Publié: (2024)
par: Amadeus, Marcellus, et autres
Publié: (2024)
Fine-tuning multilingual language models in Twitter/X sentiment analysis: a study on Eastern-European V4 languages
par: Filip, Tomáš, et autres
Publié: (2024)
par: Filip, Tomáš, et autres
Publié: (2024)
SRS-Stories: Vocabulary-constrained multilingual story generation for language learning
par: Kamzela, Wiktor, et autres
Publié: (2025)
par: Kamzela, Wiktor, et autres
Publié: (2025)
Understanding the effects of language-specific class imbalance in multilingual fine-tuning
par: Jung, Vincent, et autres
Publié: (2024)
par: Jung, Vincent, et autres
Publié: (2024)
Development and bilingual evaluation of Japanese medical large language model within reasonably low computational resources
par: Sukeda, Issey
Publié: (2024)
par: Sukeda, Issey
Publié: (2024)
Multilingual jailbreaking of LLMs using low-resource languages
par: Marx, Dylan, et autres
Publié: (2026)
par: Marx, Dylan, et autres
Publié: (2026)
Investigating the interaction of linguistic and mathematical reasoning in language models using multilingual number puzzles
par: Bhattacharya, Antara Raaghavi, et autres
Publié: (2025)
par: Bhattacharya, Antara Raaghavi, et autres
Publié: (2025)
Empirical study of pretrained multilingual language models for zero-shot cross-lingual knowledge transfer in generation
par: Chirkova, Nadezhda, et autres
Publié: (2023)
par: Chirkova, Nadezhda, et autres
Publié: (2023)
Information availability in different languages and various technological constraints related to multilinguism on the Internet
par: Khosla, Sonal, et autres
Publié: (2025)
par: Khosla, Sonal, et autres
Publié: (2025)
Artificial intelligence language technologies in multilingual healthcare: Grand challenges ahead
par: Briva-Iglesias, Vicent
Publié: (2026)
par: Briva-Iglesias, Vicent
Publié: (2026)
WorldMedQA-V: a multilingual, multimodal medical examination dataset for multimodal language models evaluation
par: Matos, João, et autres
Publié: (2024)
par: Matos, João, et autres
Publié: (2024)
Leveraging LLMs for MT in Crisis Scenarios: a blueprint for low-resource languages
par: Lankford, Séamus, et autres
Publié: (2024)
par: Lankford, Séamus, et autres
Publié: (2024)
Building low-resource African language corpora: A case study of Kidawida, Kalenjin and Dholuo
par: Mbogho, Audrey, et autres
Publié: (2025)
par: Mbogho, Audrey, et autres
Publié: (2025)
The Greek podcast corpus: Competitive speech models for low-resourced languages with weakly supervised data
par: Paraskevopoulos, Georgios, et autres
Publié: (2024)
par: Paraskevopoulos, Georgios, et autres
Publié: (2024)
How do datasets, developers, and models affect biases in a low-resourced language?: The Case of the Bengali Language
par: Das, Dipto, et autres
Publié: (2025)
par: Das, Dipto, et autres
Publié: (2025)
MultiLoKo: a multilingual local knowledge benchmark for LLMs spanning 31 languages
par: Hupkes, Dieuwke, et autres
Publié: (2025)
par: Hupkes, Dieuwke, et autres
Publié: (2025)
A comparison of pipelines for the translation of a low resource language based on transformers
par: Bonfanti, Chiara, et autres
Publié: (2025)
par: Bonfanti, Chiara, et autres
Publié: (2025)
Yor-Sarc: A gold-standard dataset for sarcasm detection in a low-resource African language
par: Jimoh, Toheeb Aduramomi, et autres
Publié: (2026)
par: Jimoh, Toheeb Aduramomi, et autres
Publié: (2026)
Prompt and circumstance: A word-by-word LLM prompting approach to interlinear glossing for low-resource languages
par: Elsner, Micha, et autres
Publié: (2025)
par: Elsner, Micha, et autres
Publié: (2025)
Large language models have learned to use language
par: Lupyan, Gary
Publié: (2025)
par: Lupyan, Gary
Publié: (2025)
A multilingual dataset for offensive language and hate speech detection for hausa, yoruba and igbo languages
par: Aliyu, Saminu Mohammad, et autres
Publié: (2024)
par: Aliyu, Saminu Mohammad, et autres
Publié: (2024)
The taste of IPA: Towards open-vocabulary keyword spotting and forced alignment in any language
par: Zhu, Jian, et autres
Publié: (2023)
par: Zhu, Jian, et autres
Publié: (2023)
Retrieval augmentation of large language models for lay language generation
par: Guo, Yue, et autres
Publié: (2022)
par: Guo, Yue, et autres
Publié: (2022)
Do large language models resemble humans in language use?
par: Cai, Zhenguang G., et autres
Publié: (2023)
par: Cai, Zhenguang G., et autres
Publié: (2023)
Studies with impossible languages falsify LMs as models of human language
par: Bowers, Jeffrey S., et autres
Publié: (2025)
par: Bowers, Jeffrey S., et autres
Publié: (2025)
Can we teach language models to gloss endangered languages?
par: Ginn, Michael, et autres
Publié: (2024)
par: Ginn, Michael, et autres
Publié: (2024)
A multilingual training strategy for low resource Text to Speech
par: Amalas, Asma, et autres
Publié: (2024)
par: Amalas, Asma, et autres
Publié: (2024)
Tiny language models
par: Gross, Ronit D., et autres
Publié: (2025)
par: Gross, Ronit D., et autres
Publié: (2025)
Large language models are not about natural language
par: Bolhuis, Johan J., et autres
Publié: (2025)
par: Bolhuis, Johan J., et autres
Publié: (2025)
Dissociating language and thought in large language models
par: Mahowald, Kyle, et autres
Publié: (2023)
par: Mahowald, Kyle, et autres
Publié: (2023)
Does language matter for spoken word classification? A multilingual generative meta-learning approach
par: Ziki, Batsirayi Mupamhi, et autres
Publié: (2026)
par: Ziki, Batsirayi Mupamhi, et autres
Publié: (2026)
synthocr-gen: A synthetic ocr dataset generator for low-resource languages- breaking the data barrier
par: Malik, Haq Nawaz, et autres
Publié: (2026)
par: Malik, Haq Nawaz, et autres
Publié: (2026)
Prompting language influences diagnostic reasoning and accuracy of large language models
par: Bazoge, Adrien, et autres
Publié: (2026)
par: Bazoge, Adrien, et autres
Publié: (2026)
Documents similaires
-
InkubaLM: A small language model for low-resource African languages
par: Tonja, Atnafu Lambebo, et autres
Publié: (2024) -
EuroGEST: Investigating gender stereotypes in multilingual language models
par: Rowe, Jacqueline, et autres
Publié: (2025) -
Morphological evaluation of subwords vocabulary used by BETO language model
par: García-Sierra, Óscar, et autres
Publié: (2024) -
The Lucie-7B LLM and the Lucie Training Dataset: Open resources for multilingual language generation
par: Gouvert, Olivier, et autres
Publié: (2025) -
One ruler to measure them all: Benchmarking multilingual long-context language models
par: Kim, Yekyung, et autres
Publié: (2025)