Image de couverture de livre

Transferring BERT Capabilities from High-Resource to Low-Resource Languages Using Vocabulary Matching

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Rybak, Piotr
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Dictionaries to the Rescue: Cross-Lingual Vocabulary Transfer for Low-Resource Languages Using Bilingual Dictionaries
par: Sakajo, Haruki, et autres
Publié: (2025)

Trans-Tokenization and Cross-lingual Vocabulary Transfers: Language Adaptation of LLMs for Low-Resource NLP
par: Remy, François, et autres
Publié: (2024)

On Importance of Layer Pruning for Smaller BERT Models and Low Resource Languages
par: Shirke, Mayur, et autres
Publié: (2025)

MaiBERT: A Pre-training Corpus and Language Model for Low-Resourced Maithili Language
par: Yadav, Sumit, et autres
Publié: (2025)

LakotaBERT: A Transformer-based Model for Low Resource Lakota Language
par: Parankusham, Kanishka, et autres
Publié: (2025)

Pruning for Performance: Efficient Idiom and Metaphor Classification in Low-Resource Konkani Using mBERT
par: Do, Timothy, et autres
Publié: (2025)

BhashaSetu: Cross-Lingual Knowledge Transfer from High-Resource to Extreme Low-Resource Languages
par: Maji, Subhadip, et autres
Publié: (2026)

Improving Low-Resource Machine Translation via Cross-Linguistic Transfer from Typologically Similar High-Resource Languages
par: Boujkian, Saughmon
Publié: (2024)

Cross-Lingual Transfer for Low-Resource Natural Language Processing
par: García-Ferrero, Iker
Publié: (2025)

PolQA: Polish Question Answering Dataset
par: Rybak, Piotr, et autres
Publié: (2022)

From Scarcity to Capability: Empowering Fake News Detection in Low-Resource Languages with LLMs
par: Shibu, Hrithik Majumdar, et autres
Publié: (2025)

Multilingual Transfer and Domain Adaptation for Low-Resource Languages of Spain
par: Luo, Yuanchang, et autres
Publié: (2024)

Silver Retriever: Advancing Neural Passage Retrieval for Polish Question Answering
par: Rybak, Piotr, et autres
Publié: (2023)

Enhancing BERT Fine-Tuning for Sentiment Analysis in Lower-Resourced Languages
par: Kubík, Jozef, et autres
Publié: (2025)

MELLA: Bridging Linguistic Capability and Cultural Groundedness for Low-Resource Language MLLMs
par: Gao, Yufei, et autres
Publié: (2025)

Machine Translation Advancements of Low-Resource Indian Languages by Transfer Learning
par: Wei, Bin, et autres
Publié: (2024)

Multi-BERT: Leveraging Adapters and Prompt Tuning for Low-Resource Multi-Domain Adaptation
par: Azad, Parham Abed, et autres
Publié: (2024)

Investigating the Transferability of Code Repair for Low-Resource Programming Languages
par: Wong, Kyle, et autres
Publié: (2024)

Enhancing Low-Resource Language and Instruction Following Capabilities of Audio Language Models
par: Manakul, Potsawee, et autres
Publié: (2024)

NLPre: a revised approach towards language-centric benchmarking of Natural Language Preprocessing systems
par: Wiącek, Martyna, et autres
Publié: (2024)

The Zeno's Paradox of `Low-Resource' Languages
par: Nigatu, Hellina Hailu, et autres
Publié: (2024)

Bootstrapping Embeddings for Low Resource Languages
par: Basoz, Merve, et autres
Publié: (2026)

Knowledge Transfer from High-Resource to Low-Resource Programming Languages for Code LLMs
par: Cassano, Federico, et autres
Publié: (2023)

Left Behind: Cross-Lingual Transfer as a Bridge for Low-Resource Languages in Large Language Models
par: Beibitkhan, Abdul-Salem
Publié: (2026)

Cross-Lingual Transfer from Related Languages: Treating Low-Resource Maltese as Multilingual Code-Switching
par: Micallef, Kurt, et autres
Publié: (2024)

UniBridge: A Unified Approach to Cross-Lingual Transfer Learning for Low-Resource Languages
par: Pham, Trinh, et autres
Publié: (2024)

CUTE: A Multilingual Dataset for Enhancing Cross-Lingual Knowledge Transfer in Low-Resource Languages
par: Zhuang, Wenhao, et autres
Publié: (2025)

Dependency Parsing Across the Resource Spectrum: Evaluating Architectures on High and Low-Resource Languages
par: Guan, Kevin, et autres
Publié: (2026)

SSP: Self-Supervised Prompting for Cross-Lingual Transfer to Low-Resource Languages using Large Language Models
par: Rathore, Vipul, et autres
Publié: (2024)

GlotLID: Language Identification for Low-Resource Languages
par: Kargaran, Amir Hossein, et autres
Publié: (2023)

Investigating Hallucination in Conversations for Low Resource Languages
par: Das, Amit, et autres
Publié: (2025)

Reducing Tokenization Premiums for Low-Resource Languages
par: Churchill, Geoffrey, et autres
Publié: (2026)

To Translate or Not to Translate: A Systematic Investigation of Translation-Based Cross-Lingual Transfer to Low-Resource Languages
par: Ebing, Benedikt, et autres
Publié: (2023)

Testing Low-Resource Language Support in LLMs Using Language Proficiency Exams: the Case of Luxembourgish
par: Lothritz, Cedric, et autres
Publié: (2025)

Enhancing Multilingual Capabilities of Large Language Models through Self-Distillation from Resource-Rich Languages
par: Zhang, Yuanchi, et autres
Publié: (2024)

Cost-Performance Optimization for Processing Low-Resource Language Tasks Using Commercial LLMs
par: Nag, Arijit, et autres
Publié: (2024)

Low-Resource, High-Impact: Building Corpora for Inclusive Language Technologies
par: Artemova, Ekaterina, et autres
Publié: (2025)

On Multilingual Encoder Language Model Compression for Low-Resource Languages
par: Gurgurov, Daniil, et autres
Publié: (2025)

Language Portability Strategies for Open-domain Dialogue with Pre-trained Language Models from High to Low Resource Languages
par: Njifenjou, Ahmed, et autres
Publié: (2024)

Reasoning Transfer for an Extremely Low-Resource and Endangered Language: Bridging Languages Through Sample-Efficient Language Understanding
par: Tran, Khanh-Tung, et autres
Publié: (2025)