Imagen de Portada

PersLitEval: Fine-grained Benchmark and Evaluation of LLMs on Persian Literature Questions

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Niazi, Ruhallah, Ghorbanpour, Faeze, Fraser, Alexander
Formato:	Preprint
Publicado:	2026
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

On the Sensitivity of Instruction-tuned LLMs to Harmful Sentences in Long Inputs
por: Ghorbanpour, Faeze, et al.
Publicado: (2025)

Can Prompting LLMs Unlock Hate Speech Detection across Languages? A Zero-shot and Few-shot Study
por: Ghorbanpour, Faeze, et al.
Publicado: (2025)

Data-Efficient Hate Speech Detection via Cross-Lingual Nearest Neighbor Retrieval with Limited Labeled Data
por: Ghorbanpour, Faeze, et al.
Publicado: (2025)

Are BabyLMs Second Language Learners?
por: Edman, Lukas, et al.
Publicado: (2024)

PerHalluEval: Persian Hallucination Evaluation Benchmark for Large Language Models
por: Hosseini, Mohammad, et al.
Publicado: (2025)

AraHalluEval: A Fine-grained Hallucination Evaluation Framework for Arabic LLMs
por: Alansari, Aisha, et al.
Publicado: (2025)

Differentiating Emigration from Return Migration of Scholars Using Name-Based Nationality Detection Models
por: Ghorbanpour, Faeze, et al.
Publicado: (2025)

LitLLMs, LLMs for Literature Review: Are we there yet?
por: Agarwal, Shubham, et al.
Publicado: (2024)

SciLitLLM: How to Adapt LLMs for Scientific Literature Understanding
por: Li, Sihang, et al.
Publicado: (2024)

PerMedCQA: Benchmarking Large Language Models on Medical Consumer Question Answering in Persian Language
por: Jamali, Naghmeh, et al.
Publicado: (2025)

PerCul: A Story-Driven Cultural Evaluation of LLMs in Persian
por: Monazzah, Erfan Moosavi, et al.
Publicado: (2025)

MAS-LitEval : Multi-Agent System for Literary Translation Quality Assessment
por: Kim, Junghwan, et al.
Publicado: (2025)

LitSearch: A Retrieval Benchmark for Scientific Literature Search
por: Ajith, Anirudh, et al.
Publicado: (2024)

LitBench: A Benchmark and Dataset for Reliable Evaluation of Creative Writing
por: Fein, Daniel, et al.
Publicado: (2025)

Conversational Exploration of Literature Landscape with LitChat
por: Huang, Mingyu, et al.
Publicado: (2025)

TARAZ: Persian Short-Answer Question Benchmark for Cultural Evaluation of Language Models
por: Iranmanesh, Reihaneh, et al.
Publicado: (2026)

MM-Eval: A Hierarchical Benchmark for Modern Mongolian Evaluation in LLMs
por: Zhang, Mengyuan, et al.
Publicado: (2024)

FineSurE: Fine-grained Summarization Evaluation using LLMs
por: Song, Hwanjun, et al.
Publicado: (2024)

HKCanto-Eval: A Benchmark for Evaluating Cantonese Language Understanding and Cultural Comprehension in LLMs
por: Cheng, Tsz Chung, et al.
Publicado: (2025)

Compound-QA: A Benchmark for Evaluating LLMs on Compound Questions
por: Hou, Yutao, et al.
Publicado: (2024)

Hal-Eval: A Universal and Fine-grained Hallucination Evaluation Framework for Large Vision Language Models
por: Jiang, Chaoya, et al.
Publicado: (2024)

LitLLM: A Toolkit for Scientific Literature Review
por: Agarwal, Shubham, et al.
Publicado: (2024)

LatEval: An Interactive LLMs Evaluation Benchmark with Incomplete Information from Lateral Thinking Puzzles
por: Huang, Shulin, et al.
Publicado: (2023)

PARSE: An Open-Domain Reasoning Question Answering Benchmark for Persian
por: Mozafari, Jamshid, et al.
Publicado: (2026)

GeoEval: Benchmark for Evaluating LLMs and Multi-Modal Models on Geometry Problem-Solving
por: Zhang, Jiaxin, et al.
Publicado: (2024)

UniSumEval: Towards Unified, Fine-Grained, Multi-Dimensional Summarization Evaluation for LLMs
por: Lee, Yuho, et al.
Publicado: (2024)

EVQAScore: A Fine-grained Metric for Video Question Answering Data Quality Evaluation
por: Liang, Hao, et al.
Publicado: (2024)

LitVISTA: A Benchmark for Narrative Orchestration in Literary Text
por: Lu, Mingzhe, et al.
Publicado: (2026)

DependEval: Benchmarking LLMs for Repository Dependency Understanding
por: Du, Junjia, et al.
Publicado: (2025)

OpenEval: Benchmarking Chinese LLMs across Capability, Alignment and Safety
por: Liu, Chuang, et al.
Publicado: (2024)

StackEval: Benchmarking LLMs in Coding Assistance
por: Shah, Nidhish, et al.
Publicado: (2024)

MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria
por: Ge, Wentao, et al.
Publicado: (2023)

FREB-TQA: A Fine-Grained Robustness Evaluation Benchmark for Table Question Answering
por: Zhou, Wei, et al.
Publicado: (2024)

LLMs Beyond English: Scaling the Multilingual Capability of LLMs with Cross-Lingual Feedback
por: Lai, Wen, et al.
Publicado: (2024)

Fusion-Eval: Integrating Assistant Evaluators with LLMs
por: Shu, Lei, et al.
Publicado: (2023)

Evaluating the Creativity of LLMs in Persian Literary Text Generation
por: Tourajmehr, Armin, et al.
Publicado: (2025)

Soda-Eval: Open-Domain Dialogue Evaluation in the age of LLMs
por: Mendonça, John, et al.
Publicado: (2024)

MathOPEval: A Fine-grained Evaluation Benchmark for Visual Operations of MLLMs in Mathematical Reasoning
por: Li, Xiaoyuan, et al.
Publicado: (2025)

MiLiC-Eval: Benchmarking Multilingual LLMs for China's Minority Languages
por: Zhang, Chen, et al.
Publicado: (2025)

CUTE: Measuring LLMs' Understanding of Their Tokens
por: Edman, Lukas, et al.
Publicado: (2024)