Imagen de Portada

HealthQA-BR: A System-Wide Benchmark Reveals Critical Knowledge Gaps in Large Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	D'addario, Andrew Maranhão Ventura
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Medical Malice: A Dataset for Context-Aware Safety in Healthcare LLMs
por: D'addario, Andrew Maranhão Ventura
Publicado: (2025)

FanOutQA: A Multi-Hop, Multi-Document Question Answering Benchmark for Large Language Models
por: Zhu, Andrew, et al.
Publicado: (2024)

DateLogicQA: Benchmarking Temporal Biases in Large Language Models
por: Bhatia, Gagan, et al.
Publicado: (2024)

DesignQA: A Multimodal Benchmark for Evaluating Large Language Models' Understanding of Engineering Documentation
por: Doris, Anna C., et al.
Publicado: (2024)

Chinese SafetyQA: A Safety Short-form Factuality Benchmark for Large Language Models
por: Tan, Yingshui, et al.
Publicado: (2024)

Evaluating Monolingual and Multilingual Large Language Models for Greek Question Answering: The DemosQA Benchmark
por: Mastrokostas, Charalampos, et al.
Publicado: (2026)

Benchmarking the Pedagogical Knowledge of Large Language Models
por: Lelièvre, Maxime, et al.
Publicado: (2025)

MizanQA: Benchmarking Large Language Models on Moroccan Legal Question Answering
por: Bahaj, Adil, et al.
Publicado: (2025)

RelationalFactQA: A Benchmark for Evaluating Tabular Fact Retrieval from Large Language Models
por: Satriani, Dario, et al.
Publicado: (2025)

Uncovering Competency Gaps in Large Language Models and Their Benchmarks
por: Bohacek, Maty, et al.
Publicado: (2025)

ThermoQA: A Three-Tier Benchmark for Evaluating Thermodynamic Reasoning in Large Language Models
por: Düzkar, Kemal
Publicado: (2026)

IPBench: Benchmarking the Knowledge of Large Language Models in Intellectual Property
por: Wang, Qiyao, et al.
Publicado: (2025)

Exposing Numeracy Gaps: A Benchmark to Evaluate Fundamental Numerical Abilities in Large Language Models
por: Li, Haoyang, et al.
Publicado: (2025)

Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts
por: Xie, Jian, et al.
Publicado: (2023)

EnviroExam: Benchmarking Environmental Science Knowledge of Large Language Models
por: Huang, Yu, et al.
Publicado: (2024)

Can Large Language Models Derive New Knowledge? A Dynamic Benchmark for Biological Knowledge Discovery
por: Yang, Chaoqun, et al.
Publicado: (2026)

A Women's Health Benchmark for Large Language Models
por: Gruber, Victoria-Elisabeth, et al.
Publicado: (2025)

Neural Incompatibility: The Unbridgeable Gap of Cross-Scale Parametric Knowledge Transfer in Large Language Models
por: Tan, Yuqiao, et al.
Publicado: (2025)

Retrieval-Constrained Decoding Reveals Underestimated Parametric Knowledge in Language Models
por: Hamdani, Rajaa El, et al.
Publicado: (2025)

Self-Prompting Large Language Models for Zero-Shot Open-Domain QA
por: Li, Junlong, et al.
Publicado: (2022)

M3SciQA: A Multi-Modal Multi-Document Scientific QA Benchmark for Evaluating Foundation Models
por: Li, Chuhan, et al.
Publicado: (2024)

When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards
por: Alzahrani, Norah, et al.
Publicado: (2024)

BR-TaxQA-R: A Dataset for Question Answering with References for Brazilian Personal Income Tax Law, including case law
por: Júnior, Juvenal Domingos, et al.
Publicado: (2025)

Retrieval Augmented Generation-based Large Language Models for Bridging Transportation Cybersecurity Legal Knowledge Gaps
por: Akbar, Khandakar Ashrafi, et al.
Publicado: (2025)

CriticEval: Evaluating Large Language Model as Critic
por: Lan, Tian, et al.
Publicado: (2024)

Assessing The Potential Of Mid-Sized Language Models For Clinical QA
por: Bolton, Elliot, et al.
Publicado: (2024)

Closing the Confidence-Faithfulness Gap in Large Language Models
por: Miao, Miranda Muqing, et al.
Publicado: (2026)

TrustMH-Bench: A Comprehensive Benchmark for Evaluating the Trustworthiness of Large Language Models in Mental Health
por: Xiong, Zixin, et al.
Publicado: (2026)

Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems
por: Cui, Tianyu, et al.
Publicado: (2024)

Knowledge Tagging with Large Language Model based Multi-Agent System
por: Li, Hang, et al.
Publicado: (2024)

BAGEL: Benchmarking Animal Knowledge Expertise in Language Models
por: Shen, Jiacheng, et al.
Publicado: (2026)

ECG-Expert-QA: A Benchmark for Evaluating Medical Large Language Models in Heart Disease Diagnosis
por: Wang, Xu, et al.
Publicado: (2025)

GAPMAP: Mapping Scientific Knowledge Gaps in Biomedical Literature Using Large Language Models
por: Salem, Nourah M, et al.
Publicado: (2025)

VLKEB: A Large Vision-Language Model Knowledge Editing Benchmark
por: Huang, Han, et al.
Publicado: (2024)

Phonetic Perturbations Reveal Tokenizer-Rooted Safety Gaps in LLMs
por: Aswal, Darpan, et al.
Publicado: (2025)

VerifyBench: Benchmarking Reference-based Reward Systems for Large Language Models
por: Yan, Yuchen, et al.
Publicado: (2025)

Revealing the Numeracy Gap: An Empirical Investigation of Text Embedding Models
por: Deng, Ningyuan, et al.
Publicado: (2025)

WoLF: Wide-scope Large Language Model Framework for CXR Understanding
por: Kang, Seil, et al.
Publicado: (2024)

Do LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmark
por: Choi, Minje, et al.
Publicado: (2023)

RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models
por: Jin, Zhuoran, et al.
Publicado: (2024)