Copertina

CQA-Eval: Designing Reliable Evaluations of Multi-paragraph Clinical QA under Resource Constraints

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Bologna, Federica, Pan, Tiffany, Wilkens, Matthew, Guo, Yue, Wang, Lucy Lu
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

VERT: Reliable LLM Judges for Radiology Report Evaluation
di: Bologna, Federica, et al.
Pubblicazione: (2026)

TruthEval: A Dataset to Evaluate LLM Truthfulness and Reliability
di: Khatun, Aisha, et al.
Pubblicazione: (2024)

SymLoc: Symbolic Localization of Hallucination across HaluEval and TruthfulQA
di: Lamba, Naveen, et al.
Pubblicazione: (2025)

PerMedCQA: Benchmarking Large Language Models on Medical Consumer Question Answering in Persian Language
di: Jamali, Naghmeh, et al.
Pubblicazione: (2025)

Investigating Symbolic Triggers of Hallucination in Gemma Models Across HaluEval and TruthfulQA
di: Lamba, Naveen, et al.
Pubblicazione: (2025)

M3SciQA: A Multi-Modal Multi-Document Scientific QA Benchmark for Evaluating Foundation Models
di: Li, Chuhan, et al.
Pubblicazione: (2024)

AirQA: A Comprehensive QA Dataset for AI Research with Instance-Level Evaluation
di: Huang, Tiancheng, et al.
Pubblicazione: (2025)

MedQA-CS: Objective Structured Clinical Examination (OSCE)-Style Benchmark for Evaluating LLM Clinical Skills
di: Yao, Zonghai, et al.
Pubblicazione: (2024)

NLP at UC Santa Cruz at SemEval-2024 Task 5: Legal Answer Validation using Few-Shot Multi-Choice QA
di: Pahilajani, Anish, et al.
Pubblicazione: (2024)

CoreEval: Automatically Building Contamination-Resilient Datasets with Real-World Knowledge toward Reliable LLM Evaluation
di: Zhao, Jingqian, et al.
Pubblicazione: (2025)

LiteraryQA: Towards Effective Evaluation of Long-document Narrative QA
di: Bonomo, Tommaso, et al.
Pubblicazione: (2025)

EduEval: A Hierarchical Cognitive Benchmark for Evaluating Large Language Models in Chinese Education
di: Ma, Guoqing, et al.
Pubblicazione: (2025)

A Comprehensive Evaluation of LLM Unlearning Robustness under Multi-Turn Interaction
di: Pan, Ruihao, et al.
Pubblicazione: (2026)

DesignQA: A Multimodal Benchmark for Evaluating Large Language Models' Understanding of Engineering Documentation
di: Doris, Anna C., et al.
Pubblicazione: (2024)

Multi-LogiEval: Towards Evaluating Multi-Step Logical Reasoning Ability of Large Language Models
di: Patel, Nisarg, et al.
Pubblicazione: (2024)

Reliability Gated Multi-Teacher Distillation for Low Resource Abstractive Summarization
di: Sumit, Dipto, et al.
Pubblicazione: (2026)

LyS at SemEval 2025 Task 8: Zero-Shot Code Generation for Tabular QA
di: Gude, Adrián, et al.
Pubblicazione: (2025)

GeoEval: Benchmark for Evaluating LLMs and Multi-Modal Models on Geometry Problem-Solving
di: Zhang, Jiaxin, et al.
Pubblicazione: (2024)

LC-Eval: A Bilingual Multi-Task Evaluation Benchmark for Long-Context Understanding
di: Jubair, Sheikh, et al.
Pubblicazione: (2025)

TCE at Qur'an QA 2023 Shared Task: Low Resource Enhanced Transformer-based Ensemble Approach for Qur'anic QA
di: Elkomy, Mohammed Alaa, et al.
Pubblicazione: (2024)

Assessing The Potential Of Mid-Sized Language Models For Clinical QA
di: Bolton, Elliot, et al.
Pubblicazione: (2024)

ConCodeEval: Evaluating Large Language Models for Code Constraints in Domain-Specific Languages
di: Kammakomati, Mehant, et al.
Pubblicazione: (2024)

NarraBench: A Comprehensive Framework for Narrative Benchmarking
di: Hamilton, Sil, et al.
Pubblicazione: (2025)

Fusion-Eval: Integrating Assistant Evaluators with LLMs
di: Shu, Lei, et al.
Pubblicazione: (2023)

Clinical QA 2.0: Multi-Task Learning for Answer Extraction and Categorization
di: Pattnayak, Priyaranjan, et al.
Pubblicazione: (2025)

LexInstructEval: Lexical Instruction Following Evaluation for Large Language Models
di: Ren, Huimin, et al.
Pubblicazione: (2025)

FreeEval: A Modular Framework for Trustworthy and Efficient Evaluation of Large Language Models
di: Yu, Zhuohao, et al.
Pubblicazione: (2024)

UniSumEval: Towards Unified, Fine-Grained, Multi-Dimensional Summarization Evaluation for LLMs
di: Lee, Yuho, et al.
Pubblicazione: (2024)

SKG-Eval: Stateful Evaluation of Multi-Turn Dialogue via Incremental Semantic Knowledge Graphs
di: Shil, Avijit, et al.
Pubblicazione: (2026)

MyCulture: Exploring Malaysia's Diverse Culture under Low-Resource Language Constraints
di: Hew, Zhong Ken, et al.
Pubblicazione: (2025)

CriticEval: Evaluating Large Language Model as Critic
di: Lan, Tian, et al.
Pubblicazione: (2024)

ReviewEval: An Evaluation Framework for AI-Generated Reviews
di: Garg, Madhav Krishan, et al.
Pubblicazione: (2025)

BenHalluEval: A Multi-Task Hallucination Evaluation Framework for Large Language Models on Bengali
di: Adib, Shefayat E Shams, et al.
Pubblicazione: (2026)

Understanding QA generation: Extracting Parametric and Contextual Knowledge with CQA for Low Resource Bangla Language
di: Azmary, Umme Abira, et al.
Pubblicazione: (2026)

FairytaleQA Translated: Enabling Educational Question and Answer Generation in Less-Resourced Languages
di: Leite, Bernardo, et al.
Pubblicazione: (2024)

Q-Mirror: Unlocking the Multi-Modal Potential of Scientific Text-Only QA Pairs
di: Wang, Junying, et al.
Pubblicazione: (2025)

MTQ-Eval: Multilingual Text Quality Evaluation for Language Models
di: Pokharel, Rhitabrat, et al.
Pubblicazione: (2025)

EpiK-Eval: Evaluation for Language Models as Epistemic Models
di: Prato, Gabriele, et al.
Pubblicazione: (2023)

ScholarEval: Research Idea Evaluation Grounded in Literature
di: Moussa, Hanane Nour, et al.
Pubblicazione: (2025)

HiQA: A Hierarchical Contextual Augmentation RAG for Multi-Documents QA
di: Chen, Xinyue, et al.
Pubblicazione: (2024)