Cover Image

AfriqueLLM: How Data Mixing and Model Architecture Impact Continued Pre-training for African Languages

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yu, Hao, Xu, Tianyi, Hedderich, Michael A., Hamidouche, Wassim, Zamir, Syed Waqas, Adelani, David Ifeoluwa
Format:	Preprint
Published:	2026
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

TukaBench: A Culturally Grounded Jailbreak Benchmark for African Languages
by: Akinode, Victor, et al.
Published: (2026)

AI Diffusion in Low Resource Language Countries
by: Misra, Amit, et al.
Published: (2025)

Charting the Landscape of African NLP: Mapping Progress and Shaping the Road Ahead
by: Alabi, Jesujoba O., et al.
Published: (2025)

Natural language processing for African languages
by: Adelani, David Ifeoluwa
Published: (2025)

BYOL: Bring Your Own Language Into LLMs
by: Zamir, Syed Waqas, et al.
Published: (2026)

AfriMTEB and AfriE5: Benchmarking and Adapting Text Embedding Models for African Languages
by: Uemura, Kosei, et al.
Published: (2025)

Lugha-Llama: Adapting Large Language Models for African Languages
by: Buzaaba, Happy, et al.
Published: (2025)

ANGOFA: Leveraging OFA Embedding Initialization and Synthetic Data for Angolan Language Model
by: Quinjica, Osvaldo Luamba, et al.
Published: (2024)

AfroBench: How Good are Large Language Models on African Languages?
by: Ojo, Jessica, et al.
Published: (2023)

AfroXLMR-Social: Adapting Pre-trained Language Models for African Languages Social Media Text
by: Belay, Tadesse Destaw, et al.
Published: (2025)

AfriHG: News headline generation for African Languages
by: Ogunremi, Toyib, et al.
Published: (2024)

Improving Multilingual Math Reasoning for African Languages
by: Ogundepo, Odunayo, et al.
Published: (2025)

Dynamic Pre-training: Towards Efficient and Scalable All-in-One Image Restoration
by: Dudhane, Akshay, et al.
Published: (2024)

DIVERS-Bench: Evaluating Language Identification Across Domain Shifts and Code-Switching
by: Ojo, Jessica, et al.
Published: (2025)

MINERS: Multilingual Language Models as Semantic Retrievers
by: Winata, Genta Indra, et al.
Published: (2024)

NERV++: An Enhanced Implicit Neural Video Representation
by: Ghorbel, Ahmed, et al.
Published: (2024)

Immersive Media and Massive Twinning: Advancing Towards the Metaverse
by: Hamidouche, Wassim, et al.
Published: (2023)

Joint Hierarchical Priors and Adaptive Spatial Resolution for Efficient Neural Image Compression
by: Ghorbel, Ahmed, et al.
Published: (2023)

Comparing LLM prompting with Cross-lingual transfer performance on Indigenous and Low-resource Brazilian Languages
by: Adelani, David Ifeoluwa, et al.
Published: (2024)

Fleurs-SLU: A Massively Multilingual Benchmark for Spoken Language Understanding
by: Schmidt, Fabian David, et al.
Published: (2025)

ODVista: An Omnidirectional Video Dataset for super-resolution and Quality Enhancement Tasks
by: Telili, Ahmed, et al.
Published: (2024)

Data Mixing Agent: Learning to Re-weight Domains for Continual Pre-training
by: Yang, Kailai, et al.
Published: (2025)

Harnessing the Power of Large Vision Language Models for Synthetic Image Detection
by: Keita, Mamadou, et al.
Published: (2024)

An Empirical Study of Many-Shot In-Context Learning for Machine Translation of Low-Resource Languages
by: Lu, Yinhan, et al.
Published: (2026)

Designing Object Detection Models for TinyML: Foundations, Comparative Analysis, Challenges, and Emerging Solutions
by: Zeinaty, Christophe EL, et al.
Published: (2025)

Bi-LORA: A Vision-Language Approach for Synthetic Image Detection
by: Keita, Mamadou, et al.
Published: (2024)

FIDAVL: Fake Image Detection and Attribution using Vision-Language Model
by: Keita, Mamadou, et al.
Published: (2024)

VIP: Visual Information Protection through Adversarial Attacks on Vision-Language Models
by: Meftah, Hanene F. Z. Brachemi, et al.
Published: (2025)

Multilinguality as Sense Adaptation
by: Cruz, Jan Christian Blaise, et al.
Published: (2026)

Does Generative AI speak Nigerian-Pidgin?: Issues about Representativeness and Bias for Multilingualism in LLMs
by: Adelani, David Ifeoluwa, et al.
Published: (2024)

The NaijaVoices Dataset: Cultivating Large-Scale, High-Quality, Culturally-Rich Speech Data for African Languages
by: Emezue, Chris, et al.
Published: (2025)

RegMix: Data Mixture as Regression for Language Model Pre-training
by: Liu, Qian, et al.
Published: (2024)

Bi‐ LORA : A Vision‐Language Approach for Synthetic Image Detection
by: Mamadou Keita, et al.
Published: (2025)

Can LLMs Revolutionize the Design of Explainable and Efficient TinyML Models?
by: Zeinaty, Christophe El, et al.
Published: (2025)

ÌròyìnSpeech: A multi-purpose Yorùbá Speech Corpus
by: Ogunremi, Tolulope, et al.
Published: (2023)

TiMix: Text-aware Image Mixing for Effective Vision-Language Pre-training
by: Jiang, Chaoya, et al.
Published: (2023)

Improving Language Plasticity via Pretraining with Active Forgetting
by: Chen, Yihong, et al.
Published: (2023)

Understanding Data Temporality Impact on Large Language Models Pre-training
by: Pilchen, Hippolyte, et al.
Published: (2026)

Winter Soldier: Backdooring Language Models at Pre-Training with Indirect Data Poisoning
by: Bouaziz, Wassim, et al.
Published: (2025)

DeeCLIP: A Robust and Generalizable Transformer-Based Framework for Detecting AI-Generated Images
by: Keita, Mamadou, et al.
Published: (2025)