Copertina

Rethinking Evidence Hierarchies in Medical Language Benchmarks: A Critical Evaluation of HealthBench

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Mutisya, Fred, Gitau, Shikoh, Ongoma, Nasubo, Mbae, Keith, Wamicha, Elizabeth
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Mind the Gap: Evaluating the Representativeness of Quantitative Medical Language Reasoning LLM Benchmarks for African Disease Burdens
di: Mutisya, Fred, et al.
Pubblicazione: (2025)

Retrieval-Augmented Clinical Benchmarking for Contextual Model Testing in Kenyan Primary Care: A Methodology Paper
di: Mutisya, Fred, et al.
Pubblicazione: (2025)

Decomposing Physician Disagreement in HealthBench
di: Borgohain, Satya, et al.
Pubblicazione: (2026)

OpenAIs HealthBench in Action: Evaluating an LLM-Based Medical Assistant on Realistic Clinical Queries
di: Ravichandran, Sandhanakrishnan, et al.
Pubblicazione: (2025)

MDIA: A Multi-Agent Diagnostic Intelligence Pipeline on HealthBench Professional
di: Cruz, Roberto, et al.
Pubblicazione: (2026)

A Case Study of HealthBench in the Japanese Medical Context
di: HISADA, Shohei
Pubblicazione: (2025)

LiveMedBench: A Contamination-Free Medical Benchmark for LLMs with Automated Rubric Evaluation
di: Yan, Zhiling, et al.
Pubblicazione: (2026)

BenchBrowser: Retrieving Evidence for Evaluating Benchmark Validity
di: Diddee, Harshita, et al.
Pubblicazione: (2026)

TrustMH-Bench: A Comprehensive Benchmark for Evaluating the Trustworthiness of Large Language Models in Mental Health
di: Xiong, Zixin, et al.
Pubblicazione: (2026)

MedBench: A Comprehensive, Standardized, and Reliable Benchmarking System for Evaluating Chinese Medical Large Language Models
di: Liu, Mianxin, et al.
Pubblicazione: (2024)

HealthBench: Evaluating Large Language Models Towards Improved Human Health
di: Arora, Rahul K., et al.
Pubblicazione: (2025)

JMedEthicBench: A Multi-Turn Conversational Benchmark for Evaluating Medical Safety in Japanese Large Language Models
di: Liu, Junyu, et al.
Pubblicazione: (2026)

Inflated Excellence or True Performance? Rethinking Medical Diagnostic Benchmarks with Dynamic Evaluation
di: Zhang, Xiangxu, et al.
Pubblicazione: (2025)

MedSafetyBench: Evaluating and Improving the Medical Safety of Large Language Models
di: Han, Tessa, et al.
Pubblicazione: (2024)

EngiBench: A Benchmark for Evaluating Large Language Models on Engineering Problem Solving
di: Zhou, Xiyuan, et al.
Pubblicazione: (2025)

TurkBench: A Benchmark for Evaluating Turkish Large Language Models
di: Toraman, Çağrı, et al.
Pubblicazione: (2026)

ElecBench: a Power Dispatch Evaluation Benchmark for Large Language Models
di: Zhou, Xiyuan, et al.
Pubblicazione: (2024)

PHM-Bench: A Domain-Specific Benchmarking Framework for Systematic Evaluation of Large Models in Prognostics and Health Management
di: Yang, Puyu, et al.
Pubblicazione: (2025)

EchoBench: Benchmarking Sycophancy in Medical Large Vision-Language Models
di: Yuan, Botai, et al.
Pubblicazione: (2025)

MedHallBench: A New Benchmark for Assessing Hallucination in Medical Large Language Models
di: Zuo, Kaiwen, et al.
Pubblicazione: (2024)

MedCalc-Bench: Evaluating Large Language Models for Medical Calculations
di: Khandekar, Nikhil, et al.
Pubblicazione: (2024)

HealthBench Professional: Evaluating Large Language Models on Real Clinician Chats
di: Hicks, Rebecca Soskin, et al.
Pubblicazione: (2026)

Harvard Undergraduate Survey on Generative AI
di: Hirabayashi, Shikoh, et al.
Pubblicazione: (2024)

Health-ORSC-Bench: A Benchmark for Measuring Over-Refusal and Safety Completion in Health Context
di: Zhang, Zhihao, et al.
Pubblicazione: (2026)

LifeAgentBench: A Multi-dimensional Benchmark and Agent for Personal Health Assistants in Digital Health
di: Tian, Ye, et al.
Pubblicazione: (2026)

ESL-Bench: An Event-Driven Synthetic Longitudinal Benchmark for Health Agents
di: Li, Chao, et al.
Pubblicazione: (2026)

CMPhysBench: A Benchmark for Evaluating Large Language Models in Condensed Matter Physics
di: Wang, Weida, et al.
Pubblicazione: (2025)

OphthBench: A Comprehensive Benchmark for Evaluating Large Language Models in Chinese Ophthalmology
di: Zhou, Chengfeng, et al.
Pubblicazione: (2025)

SPA-Bench: A Comprehensive Benchmark for SmartPhone Agent Evaluation
di: Chen, Jingxuan, et al.
Pubblicazione: (2024)

Agent-ValueBench: A Comprehensive Benchmark for Evaluating Agent Values
di: Dong, Haonan, et al.
Pubblicazione: (2026)

CriticBench: Benchmarking LLMs for Critique-Correct Reasoning
di: Lin, Zicheng, et al.
Pubblicazione: (2024)

Rethinking and Benchmarking Large Language Models for Graph Reasoning
di: Hu, Yuwei, et al.
Pubblicazione: (2025)

Rethinking the Uncertainty: A Critical Review and Analysis in the Era of Large Language Models
di: Beigi, Mohammad, et al.
Pubblicazione: (2024)

PetroBench: A Benchmark for Large Language Models in Petroleum Engineering
di: Wang, Xiang, et al.
Pubblicazione: (2026)

MedCEG: Reinforcing Verifiable Medical Reasoning with Critical Evidence Graph
di: Mu, Linjie, et al.
Pubblicazione: (2025)

AssertBench: A Benchmark for Evaluating Self-Assertion in Large Language Models
di: Lee, Jaeho, et al.
Pubblicazione: (2025)

WXImpactBench: A Disruptive Weather Impact Understanding Benchmark for Evaluating Large Language Models
di: Yu, Yongan, et al.
Pubblicazione: (2025)

UrbanPlanBench: A Comprehensive Urban Planning Benchmark for Evaluating Large Language Models
di: Zheng, Yu, et al.
Pubblicazione: (2025)

MPCI-Bench: A Benchmark for Multimodal Pairwise Contextual Integrity Evaluation of Language Model Agents
di: Wang, Shouju, et al.
Pubblicazione: (2026)

PanCanBench: A Comprehensive Benchmark for Evaluating Large Language Models in Pancreatic Oncology
di: Zhao, Yimin, et al.
Pubblicazione: (2026)