Cover Image

Exploring Tokenization Strategies and Vocabulary Sizes for Enhanced Arabic Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Alrefaie, Mohamed Taher, Morsy, Nour Eldin, Samir, Nada
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The dynamics of meaning through time: Assessment of Large Language Models
by: Alrefaie, Mohamed Taher, et al.
Published: (2025)

Exploring the Effect of Segmentation and Vocabulary Size on Speech Tokenization for Speech Language Models
by: Kando, Shunsuke, et al.
Published: (2025)

Adaptive BPE Tokenization for Enhanced Vocabulary Adaptation in Finetuning Pretrained Language Models
by: Balde, Gunjan, et al.
Published: (2024)

Large Vocabulary Size Improves Large Language Models
by: Takase, Sho, et al.
Published: (2024)

Second Language (Arabic) Acquisition of LLMs via Progressive Vocabulary Expansion
by: Zhu, Jianqing, et al.
Published: (2024)

PAIR: A Novel Large Language Model-Guided Selection Strategy for Evolutionary Algorithms
by: Ali, Shady, et al.
Published: (2025)

Strategies for Arabic Readability Modeling
by: Liberato, Juan Piñeros, et al.
Published: (2024)

Exploring Retrieval Augmented Generation in Arabic
by: El-Beltagy, Samhaa R., et al.
Published: (2024)

Arabic Morphosyntactic Tagging and Dependency Parsing with Large Language Models
by: Adel, Mohamed, et al.
Published: (2026)

Token-level Ensembling of Models with Different Vocabularies
by: Wicks, Rachel, et al.
Published: (2025)

Enhancing Medical Support in the Arabic Language Through Personalized ChatGPT Assistance
by: Issa, Mohamed, et al.
Published: (2024)

Linguistic Uncertainty and Engagement in Arabic-Language X (formerly Twitter) Discourse
by: Soufan, Mohamed
Published: (2026)

Bridging Language Barriers in Healthcare: A Study on Arabic LLMs
by: Saadi, Nada, et al.
Published: (2025)

Enhancing Language Learning through Technology: Introducing a New English-Azerbaijani (Arabic Script) Parallel Corpus
by: Khiarak, Jalil Nourmohammadi, et al.
Published: (2024)

Obscuring Data Contamination Through Translation: Evidence from Arabic Corpora
by: Abbas, Chaymaa, et al.
Published: (2026)

Exploring Data and Parameter Efficient Strategies for Arabic Dialect Identifications
by: Kanjirangat, Vani, et al.
Published: (2025)

From FusHa to Folk: Exploring Cross-Lingual Transfer in Arabic Language Models
by: Khalak, Abdulmuizz, et al.
Published: (2026)

Exploring State Tracking Capabilities of Large Language Models
by: Rezaee, Kiamehr, et al.
Published: (2025)

The Landscape of Arabic Large Language Models (ALLMs): A New Era for Arabic Language Technology
by: Al-Khalifa, Shahad, et al.
Published: (2025)

Optimizing LLMs for Italian: Reducing Token Fertility and Enhancing Efficiency Through Vocabulary Adaptation
by: Moroni, Luca, et al.
Published: (2025)

A Severity-Based Curriculum Learning Strategy for Arabic Medical Text Generation
by: Alansary, Ahmed, et al.
Published: (2026)

Sadeed: Advancing Arabic Diacritization Through Small Language Model
by: Aldallal, Zeina, et al.
Published: (2025)

The Polish Vocabulary Size Test: A Novel Adaptive Test for Receptive Vocabulary Assessment
by: Fokin, Danil, et al.
Published: (2025)

AraToken: Optimizing Arabic Tokenization with Normalization Pipeline and Language Extension for Qwen3
by: Kashirskiy, Mark, et al.
Published: (2025)

Arabic-Nougat: Fine-Tuning Vision Transformers for Arabic OCR and Markdown Extraction
by: Rashad, Mohamed
Published: (2024)

The Tokenization Bottleneck: How Vocabulary Extension Improves Chemistry Representation Learning in Pretrained Language Models
by: Kalamkar, Prathamesh, et al.
Published: (2025)

From Arabic Text to Puzzles: LLM-Driven Development of Arabic Educational Crosswords
by: Zeinalipour, Kamyar, et al.
Published: (2025)

Nile-Chat: Egyptian Language Models for Arabic and Latin Scripts
by: Shang, Guokan, et al.
Published: (2025)

Peacock: A Family of Arabic Multimodal Large Language Models and Benchmarks
by: Alwajih, Fakhraddin, et al.
Published: (2024)

Lexicon-Enriched Graph Modeling for Arabic Document Readability Prediction
by: Elchafei, Passant, et al.
Published: (2025)

Baseer: A Vision-Language Model for Arabic Document-to-Markdown OCR
by: Hennara, Khalil, et al.
Published: (2025)

RightNow-Arabic-0.5B-Turbo: An Open Sub-1B Arabic Language Model via Vocabulary Injection and Edge-First Deployment
by: Jaber, Jaber, et al.
Published: (2026)

ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabic
by: Koto, Fajri, et al.
Published: (2024)

Pearl: A Multimodal Culturally-Aware Arabic Instruction Dataset
by: Alwajih, Fakhraddin, et al.
Published: (2025)

Enhancing Next-Generation Language Models with Knowledge Graphs: Extending Claude, Mistral IA, and GPT-4 via KG-BERT
by: Chaabene, Nour El Houda Ben, et al.
Published: (2025)

Gender Encoding Patterns in Pretrained Language Model Representations
by: Zakizadeh, Mahdi, et al.
Published: (2025)

Normalized Orthography for Tunisian Arabic
by: Turki, Houcemeddine, et al.
Published: (2024)

TokAlign: Efficient Vocabulary Adaptation via Token Alignment
by: Li, Chong, et al.
Published: (2025)

Parallel Tokenizers: Rethinking Vocabulary Design for Cross-Lingual Transfer
by: Kautsar, Muhammad Dehan Al, et al.
Published: (2025)

!MSA at AraHealthQA 2025 Shared Task: Enhancing LLM Performance for Arabic Clinical Question Answering through Prompt Engineering and Ensemble Learning
by: Tarek, Mohamed, et al.
Published: (2025)