Copertina

MasalBench: A Benchmark for Contextual and Cross-Cultural Understanding of Persian Proverbs in LLMs

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Kalhor, Ghazal, Bahrak, Behnam
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Probing Gender Bias in Multilingual LLMs: A Case Study of Stereotypes in Persian
di: Kalhor, Ghazal, et al.
Pubblicazione: (2025)

Forecasting Success of Computer Science Professors and Students Based on Their Academic and Personal Backgrounds
di: Kalhor, Ghazal, et al.
Pubblicazione: (2023)

GhazalBench: Usage-Grounded Evaluation of LLMs on Persian Ghazals
di: Kalhor, Ghazal, et al.
Pubblicazione: (2026)

Understanding Trends, Patterns, and Dynamics in Global Company Acquisitions: A Network Perspective
di: Kalhor, Ghazal, et al.
Pubblicazione: (2024)

Can LLMs Faithfully Explain Themselves in Low-Resource Languages? A Case Study on Emotion Detection in Persian
di: Mehrazar, Mobina, et al.
Pubblicazione: (2025)

Remembering Unequally: Global and Disciplinary Bias in LLM Reconstruction of Scholarly Coauthor Lists
di: Kalhor, Ghazal, et al.
Pubblicazione: (2025)

The Sufficiency-Conciseness Trade-off in LLM Self-Explanation from an Information Bottleneck Perspective
di: Zahedzadeh, Ali, et al.
Pubblicazione: (2026)

FFE-Hallu:Hallucinations in Fixed Figurative Expressions:Benchmark of Idioms and Proverbs in the Persian Language
di: Hosseini, Faezeh, et al.
Pubblicazione: (2026)

Are Multilingual LLMs Culturally-Diverse Reasoners? An Investigation into Multicultural Proverbs and Sayings
di: Liu, Chen Cecilia, et al.
Pubblicazione: (2023)

A Large-Scale Analysis of Persian Tweets Regarding Covid-19 Vaccination
di: ShabaniMirzaei, Taha, et al.
Pubblicazione: (2023)

A Statistical Analysis of LLMs' Self-Evaluation Using Proverbs
di: Sonoda, Ryosuke, et al.
Pubblicazione: (2024)

From Words to Proverbs: Evaluating LLMs Linguistic and Cultural Competence in Saudi Dialects with Absher
di: Al-Monef, Renad, et al.
Pubblicazione: (2025)

Hanfu-Bench: A Multimodal Benchmark on Cross-Temporal Cultural Understanding and Transcreation
di: Zhou, Li, et al.
Pubblicazione: (2025)

CULEMO: Cultural Lenses on Emotion -- Benchmarking LLMs for Cross-Cultural Emotion Understanding
di: Belay, Tadesse Destaw, et al.
Pubblicazione: (2025)

Proverbs Run in Pairs: Evaluating Proverb Translation Capability of Large Language Model
di: Wang, Minghan, et al.
Pubblicazione: (2025)

Jawaher: A Multidialectal Dataset of Arabic Proverbs for LLM Benchmarking
di: Magdy, Samar M., et al.
Pubblicazione: (2025)

Can LLMs Grasp Implicit Cultural Values? Benchmarking LLMs' Cultural Intelligence with CQ-Bench
di: Liu, Ziyi, et al.
Pubblicazione: (2025)

LingBench++: A Linguistically-Informed Benchmark and Reasoning Framework for Multi-Step and Cross-Cultural Inference with LLMs
di: Lian, Da-Chen, et al.
Pubblicazione: (2025)

ProverbEval: Exploring LLM Evaluation Challenges for Low-resource Language Understanding
di: Azime, Israel Abebe, et al.
Pubblicazione: (2024)

RoleConflictBench: A Benchmark of Role Conflict Scenarios for Evaluating LLMs' Contextual Sensitivity
di: Shin, Jisu, et al.
Pubblicazione: (2025)

VULCA-Bench: A Multicultural Vision-Language Benchmark for Evaluating Cultural Understanding
di: Yu, Haorui, et al.
Pubblicazione: (2026)

XCR-Bench: A Multi-Task Benchmark for Evaluating Cultural Reasoning in LLMs
di: Kabir, Mohsinul, et al.
Pubblicazione: (2026)

PARSA-Bench: A Comprehensive Persian Audio-Language Model Benchmark
di: Kalahroodi, Mohammad Javad Ranjbar, et al.
Pubblicazione: (2026)

Proverbs or Pythian Oracles? Sentiments and Emotions in Greek Sayings
di: Korre, Katerina, et al.
Pubblicazione: (2025)

CLM-Bench: Benchmarking and Analyzing Cross-lingual Misalignment of LLMs in Knowledge Editing
di: Hu, Yucheng, et al.
Pubblicazione: (2026)

DentalBench: Benchmarking and Advancing LLMs Capability for Bilingual Dentistry Understanding
di: Zhu, Hengchuan, et al.
Pubblicazione: (2025)

XL-SafetyBench: A Country-Grounded Cross-Cultural Benchmark for LLM Safety and Cultural Sensitivity
di: Choi, Dasol, et al.
Pubblicazione: (2026)

BanglaSocialBench: A Benchmark for Evaluating Sociopragmatic and Cultural Alignment of LLMs in Bangladeshi Social Interaction
di: Sijan, Tanvir Ahmed, et al.
Pubblicazione: (2026)

Do LLMs Understand Wine Descriptors Across Cultures? A Benchmark for Cultural Adaptations of Wine Reviews
di: Zou, Chenye, et al.
Pubblicazione: (2025)

Benchmarking Contextual Understanding for In-Car Conversational Systems
di: Habicht, Philipp, et al.
Pubblicazione: (2025)

SKA-Bench: A Fine-Grained Benchmark for Evaluating Structured Knowledge Understanding of LLMs
di: Liu, Zhiqiang, et al.
Pubblicazione: (2025)

HKCanto-Eval: A Benchmark for Evaluating Cantonese Language Understanding and Cultural Comprehension in LLMs
di: Cheng, Tsz Chung, et al.
Pubblicazione: (2025)

From Words to Worlds: Benchmarking Cross-Cultural Cultural Understanding in Machine Translation
di: Han, Bangju, et al.
Pubblicazione: (2026)

MELAC: Massive Evaluation of Large Language Models with Alignment of Culture in Persian Language
di: Farsi, Farhan, et al.
Pubblicazione: (2025)

Cultural Bias Matters: A Cross-Cultural Benchmark Dataset and Sentiment-Enriched Model for Understanding Multimodal Metaphors
di: Yang, Senqi, et al.
Pubblicazione: (2025)

IsoBench: Benchmarking Multimodal Foundation Models on Isomorphic Representations
di: Fu, Deqing, et al.
Pubblicazione: (2024)

RiddleBench: A New Generative Reasoning Benchmark for LLMs
di: Halder, Deepon, et al.
Pubblicazione: (2025)

FilBench: Can LLMs Understand and Generate Filipino?
di: Miranda, Lester James V., et al.
Pubblicazione: (2025)

CLaS-Bench: A Cross-Lingual Alignment and Steering Benchmark
di: Gurgurov, Daniil, et al.
Pubblicazione: (2026)

ContextASR-Bench: A Massive Contextual Speech Recognition Benchmark
di: Wang, He, et al.
Pubblicazione: (2025)