Cover Image

PalmX 2025: The First Shared Task on Benchmarking LLMs on Arabic and Islamic Culture

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Alwajih, Fakhraddin, Mekki, Abdellah El, Mubarak, Hamdy, Hawasly, Majd, Mohamed, Abubakr, Abdul-Mageed, Muhammad
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Swan and ArabicMTEB: Dialect-Aware, Arabic-Centric, Cross-Lingual, and Cross-Cultural Embedding Models and Benchmarks
by: Bhatia, Gagan, et al.
Published: (2024)

Dallah: A Dialect-Aware Multimodal Large Language Model for Arabic
by: Alwajih, Fakhraddin, et al.
Published: (2024)

Arabic Automatic Story Generation with Large Language Models
by: El-Shangiti, Ahmed Oumar, et al.
Published: (2024)

LQM: Linguistically Motivated Multidimensional Quality Metrics for Machine Translation
by: Magdy, Samar M., et al.
Published: (2026)

Peacock: A Family of Arabic Multimodal Large Language Models and Benchmarks
by: Alwajih, Fakhraddin, et al.
Published: (2024)

Effective Self-Mining of In-Context Examples for Unsupervised Machine Translation with LLMs
by: Mekki, Abdellah El, et al.
Published: (2024)

Qalam : A Multimodal LLM for Arabic Optical Character and Handwriting Recognition
by: Bhatia, Gagan, et al.
Published: (2024)

EduAdapt: A Question Answer Benchmark Dataset for Evaluating Grade-Level Adaptability in LLMs
by: Naeem, Numaan, et al.
Published: (2025)

Jawaher: A Multidialectal Dataset of Arabic Proverbs for LLM Benchmarking
by: Magdy, Samar M., et al.
Published: (2025)

Gazelle: An Instruction Dataset for Arabic Writing Assistance
by: Magdy, Samar M., et al.
Published: (2024)

NileChat: Towards Linguistically Diverse and Culturally Aware LLMs for Local Communities
by: Mekki, Abdellah El, et al.
Published: (2025)

Palm: A Culturally Inclusive and Linguistically Diverse Dataset for Arabic LLMs
by: Alwajih, Fakhraddin, et al.
Published: (2025)

CultranAI at PalmX 2025: Data Augmentation for Cultural Knowledge Representation
by: Bhatti, Hunzalah Hassan, et al.
Published: (2025)

NADI 2025: The First Multidialectal Arabic Speech Processing Shared Task
by: Talafha, Bashar, et al.
Published: (2025)

Fanar-Sadiq: A Multi-Agent Architecture for Grounded Islamic QA
by: Abbas, Ummar, et al.
Published: (2026)

AraHealthQA 2025: The First Shared Task on Arabic Health Question Answering
by: Alhuzali, Hassan, et al.
Published: (2025)

WojoodNER 2024: The Second Arabic Named Entity Recognition Shared Task
by: Jarrar, Mustafa, et al.
Published: (2024)

LAraBench: Benchmarking Arabic AI with Large Language Models
by: Abdelali, Ahmed, et al.
Published: (2023)

NADI 2024: The Fifth Nuanced Arabic Dialect Identification Shared Task
by: Abdul-Mageed, Muhammad, et al.
Published: (2024)

Casablanca: Data and Models for Multidialectal Arabic Speech Recognition
by: Talafha, Bashar, et al.
Published: (2024)

Towards Zero-Shot Text-To-Speech for Arabic Dialects
by: Doan, Khai Duy, et al.
Published: (2024)

LLMeBench: A Flexible Framework for Accelerating LLMs Benchmarking
by: Dalvi, Fahim, et al.
Published: (2023)

Beyond Orthography: Automatic Recovery of Short Vowels and Dialectal Sounds in Arabic
by: Kheir, Yassine El, et al.
Published: (2024)

Pearl: A Multimodal Culturally-Aware Arabic Instruction Dataset
by: Alwajih, Fakhraddin, et al.
Published: (2025)

CVPD at QIAS 2025 Shared Task: An Efficient Encoder-Based Approach for Islamic Inheritance Reasoning
by: Bekhouche, Salah Eddine, et al.
Published: (2025)

Who Should Set the Standards? Analysing Censored Arabic Content on Facebook during the Palestine-Israel Conflict
by: Magdy, Walid, et al.
Published: (2025)

Zero-Shot Context-Aware ASR for Diverse Arabic Varieties
by: Talafha, Bashar, et al.
Published: (2025)

Alexandria: A Multi-Domain Dialectal Arabic Machine Translation Dataset for Culturally Inclusive and Linguistically Diverse LLMs
by: Mekki, Abdellah El, et al.
Published: (2026)

Exploring Alignment in Shared Cross-lingual Spaces
by: Mousi, Basel, et al.
Published: (2024)

WASIL: In-the-Wild Arabic Spoken Interactions with LLMs
by: Ali, Zien Sheikh, et al.
Published: (2026)

Cultural Benchmarking of LLMs in Standard and Dialectal Arabic Dialogues
by: Kautsar, Muhammad Dehan Al, et al.
Published: (2026)

!MSA at BAREC Shared Task 2025: Ensembling Arabic Transformers for Readability Assessment
by: Basem, Mohamed, et al.
Published: (2025)

Scaling up Discovery of Latent Concepts in Deep NLP Models
by: Hawasly, Majd, et al.
Published: (2023)

Benchmarking the Legal Reasoning of LLMs in Arabic Islamic Inheritance Cases
by: AlDahoul, Nouar, et al.
Published: (2025)

Arab Voices: Mapping Standard and Dialectal Arabic Speech Technology
by: Sullivan, Peter, et al.
Published: (2026)

Improving Language Models Trained on Translated Data with Continual Pre-Training and Dictionary Learning Analysis
by: Boughorbel, Sabri, et al.
Published: (2024)

ArabicNLU 2024: The First Arabic Natural Language Understanding Shared Task
by: Khalilia, Mohammed, et al.
Published: (2024)

QIAS 2025: Overview of the Shared Task on Islamic Inheritance Reasoning and Knowledge Assessment
by: BOUCHEKIF, Abdessalam, et al.
Published: (2026)

AraFinNLP 2024: The First Arabic Financial NLP Shared Task
by: Malaysha, Sanad, et al.
Published: (2024)

Beyond the Leaderboard: Understanding Performance Disparities in Large Language Models via Model Diffing
by: Boughorbel, Sabri, et al.
Published: (2025)