Image de couverture de livre

AraModernBERT: Transtokenized Initialization and Long-Context Encoder Modeling for Arabic

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Elshehy, Omar, Nacar, Omer, Djamai, Abdelbasset, Ragab, Muhammed, Jallad, Khloud Al, Abdelazim, Mona
Format:	Preprint
Publié:	2026
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

ASCAT: An Arabic Scientific Corpus and Benchmark for Advanced Translation Evaluation
par: Sibaee, Serry, et autres
Publié: (2026)

Arabic Little STT: Arabic Children Speech Recognition Dataset
par: Alkadri, Mouhand, et autres
Publié: (2025)

SyriSign: A Parallel Corpus for Arabic Text to Syrian Arabic Sign Language Translation
par: Khalil, Mohammad Amer, et autres
Publié: (2026)

ArEEG_Chars: Dataset for Envisioned Speech Recognition using EEG for Arabic Characters
par: Darwish, Hazem, et autres
Publié: (2024)

ArEEG_Words: Dataset for Envisioned Speech Recognition using EEG for Arabic Words
par: Darwish, Hazem, et autres
Publié: (2024)

UI-Level Evaluation of ALLaM 34B: Measuring an Arabic-Centric LLM via HUMAIN Chat
par: Nacar, Omer
Publié: (2025)

SHAMI-MT: A Syrian Arabic Dialect to Modern Standard Arabic Bidirectional Machine Translation System
par: Sibaee, Serry, et autres
Publié: (2025)

Enhancing Semantic Similarity Understanding in Arabic NLP with Nested Embedding Learning
par: Nacar, Omer, et autres
Publié: (2024)

Abjad-Kids: An Arabic Speech Classification Dataset for Primary Education
par: Snoubara, Abdul Aziz, et autres
Publié: (2026)

AraPoemBERT: A Pretrained Language Model for Arabic Poetry Analysis
par: Qarah, Faisal
Publié: (2024)

From Guidelines to Practice: A New Paradigm for Arabic Language Model Evaluation
par: Sibaee, Serry, et autres
Publié: (2025)

QARI-OCR: High-Fidelity Arabic Text Recognition through Multimodal Large Language Model Adaptation
par: Wasfy, Ahmed, et autres
Publié: (2025)

Survey of NLU Benchmarks Diagnosing Linguistic Phenomena: Why not Standardize Diagnostics Benchmarks?
par: Jallad, Khloud AL, et autres
Publié: (2025)

Ara-HOPE: Human-Centric Post-Editing Evaluation for Dialectal Arabic to Modern Standard Arabic Translation
par: Alabdullah, Abdullah, et autres
Publié: (2025)

BioClinical ModernBERT: A State-of-the-Art Long-Context Encoder for Biomedical and Clinical NLP
par: Sounack, Thomas, et autres
Publié: (2025)

Voting-based Multimodal Automatic Deception Detection
par: Touma, Lana, et autres
Publié: (2023)

GATE: General Arabic Text Embedding for Enhanced Semantic Textual Similarity with Matryoshka Representation Learning and Hybrid Loss Training
par: Nacar, Omer, et autres
Publié: (2025)

MedAraBench: Large-Scale Arabic Medical Question Answering Dataset and Benchmark
par: Abu-Daoud, Mouath, et autres
Publié: (2026)

AraTrust: An Evaluation of Trustworthiness for LLMs in Arabic
par: Alghamdi, Emad A., et autres
Publié: (2024)

Advancing Arabic Reverse Dictionary Systems: A Transformer-Based Approach with Dataset Construction Guidelines
par: Sibaee, Serry, et autres
Publié: (2025)

AraSpot: Arabic Spoken Command Spotting
par: Salhab, Mahmoud, et autres
Publié: (2023)

Ara-Best-RQ: Multi Dialectal Arabic SSL
par: Elleuch, Haroun, et autres
Publié: (2026)

AraS2P: Arabic Speech-to-Phonemes System
par: Matar, Bassam, et autres
Publié: (2025)

AraSpider: Democratizing Arabic-to-SQL
par: Heakl, Ahmed, et autres
Publié: (2024)

AraHealthQA 2025: The First Shared Task on Arabic Health Question Answering
par: Alhuzali, Hassan, et autres
Publié: (2025)

AraReasoner: Evaluating Reasoning-Based LLMs for Arabic NLP
par: Hasanaath, Ahmed, et autres
Publié: (2025)

m3BERT: A Modern, Multi-lingual, Matryoshka Bidirectional Encoder
par: Wang, Yaoxiang, et autres
Publié: (2026)

AraSTEM: A Native Arabic Multiple Choice Question Benchmark for Evaluating LLMs Knowledge In STEM Subjects
par: Mustapha, Ahmad, et autres
Publié: (2024)

AraFinNews: Arabic Financial Summarisation with Domain-Adapted LLMs
par: El-Haj, Mo, et autres
Publié: (2025)

RexBERT: Context Specialized Bidirectional Encoders for E-commerce
par: Bajaj, Rahul, et autres
Publié: (2026)

mmBERT: A Modern Multilingual Encoder with Annealed Language Learning
par: Marone, Marc, et autres
Publié: (2025)

AraFinNLP 2024: The First Arabic Financial NLP Shared Task
par: Malaysha, Sanad, et autres
Publié: (2024)

AraTable: Benchmarking LLMs' Reasoning and Understanding of Arabic Tabular Data
par: Alshaikh, Rana, et autres
Publié: (2025)

AraSpell: A Deep Learning Approach for Arabic Spelling Correction
par: Salhab, Mahmoud, et autres
Publié: (2024)

ModernBERT or DeBERTaV3? Examining Architecture and Data Influence on Transformer Encoder Models Performance
par: Antoun, Wissam, et autres
Publié: (2025)

MrBERT: Modern Multilingual Encoders via Vocabulary, Domain, and Dimensional Adaptation
par: Tamayo, Daniel, et autres
Publié: (2026)

AraLingBench A Human-Annotated Benchmark for Evaluating Arabic Linguistic Capabilities of Large Language Models
par: Zbeeb, Mohammad, et autres
Publié: (2025)

Event-Arguments Extraction Corpus and Modeling using BERT for Arabic
par: Aljabari, Alaa, et autres
Publié: (2024)

llm-jp-modernbert: A ModernBERT Model Trained on a Large-Scale Japanese Corpus with Long Context Length
par: Sugiura, Issa, et autres
Publié: (2025)

AraHalluEval: A Fine-grained Hallucination Evaluation Framework for Arabic LLMs
par: Alansari, Aisha, et autres
Publié: (2025)