Copertina

ProtoMed-LLM: An Automatic Evaluation Framework for Large Language Models in Medical Protocol Formulation

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Yi, Seungjun, Lim, Jaeyoung, Yoon, Juyong
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

AutoMedEval: Harnessing Language Models for Automatic Medical Capability Evaluation
di: Zhang, Xiechi, et al.
Pubblicazione: (2025)

MedCalc-Bench: Evaluating Large Language Models for Medical Calculations
di: Khandekar, Nikhil, et al.
Pubblicazione: (2024)

MedHELM: Holistic Evaluation of Large Language Models for Medical Tasks
di: Bedi, Suhana, et al.
Pubblicazione: (2025)

MedEthicEval: Evaluating Large Language Models Based on Chinese Medical Ethics
di: Jin, Haoan, et al.
Pubblicazione: (2025)

EuropeMedQA Study Protocol: A Multilingual, Multimodal Medical Examination Dataset for Language Model Evaluation
di: Causio, Francesco Andrea, et al.
Pubblicazione: (2026)

MedBench-IT: A Comprehensive Benchmark for Evaluating Large Language Models on Italian Medical Entrance Examinations
di: Lazzaroni, Ruggero Marino, et al.
Pubblicazione: (2025)

CliMedBench: A Large-Scale Chinese Benchmark for Evaluating Medical Large Language Models in Clinical Scenarios
di: Ouyang, Zetian, et al.
Pubblicazione: (2024)

MedGo: A Chinese Medical Large Language Model
di: Zhang, Haitao, et al.
Pubblicazione: (2024)

Lightweight Large Language Model for Medication Enquiry: Med-Pal
di: Elangovan, Kabilan, et al.
Pubblicazione: (2024)

Auto-TA: Towards Scalable Automated Thematic Analysis (TA) via Multi-Agent Large Language Models with Reinforcement Learning
di: Yi, Seungjun, et al.
Pubblicazione: (2025)

LLM Reading Tea Leaves: Automatically Evaluating Topic Models with Large Language Models
di: Yang, Xiaohao, et al.
Pubblicazione: (2024)

Exploring Large Language Models on Cross-Cultural Values in Connection with Training Methodology
di: Kim, Minsang, et al.
Pubblicazione: (2024)

MedCalc-Eval and MedCalc-Env: Advancing Medical Calculation Capabilities of Large Language Models
di: Mao, Kangkun, et al.
Pubblicazione: (2025)

MedExpQA: Multilingual Benchmarking of Large Language Models for Medical Question Answering
di: Alonso, Iñigo, et al.
Pubblicazione: (2024)

Qilin-Med: Multi-stage Knowledge Injection Advanced Medical Large Language Model
di: Ye, Qichen, et al.
Pubblicazione: (2023)

MedDialogRubrics: A Comprehensive Benchmark and Evaluation Framework for Multi-turn Medical Consultations in Large Language Models
di: Gong, Lecheng, et al.
Pubblicazione: (2026)

MedSyn: LLM-based Synthetic Medical Text Generation Framework
di: Kumichev, Gleb, et al.
Pubblicazione: (2024)

LLM-MedQA: Enhancing Medical Question Answering through Case Studies in Large Language Models
di: Yang, Hang, et al.
Pubblicazione: (2024)

Med-RewardBench: Benchmarking Reward Models and Judges for Medical Multimodal Large Language Models
di: Ding, Meidan, et al.
Pubblicazione: (2025)

MedKGent: A Large Language Model Agent Framework for Constructing Temporally Evolving Medical Knowledge Graph
di: Zhang, Duzhen, et al.
Pubblicazione: (2025)

FocusMed: A Large Language Model-based Framework for Enhancing Medical Question Summarization with Focus Identification
di: Liu, Chao, et al.
Pubblicazione: (2025)

MedBench: A Comprehensive, Standardized, and Reliable Benchmarking System for Evaluating Chinese Medical Large Language Models
di: Liu, Mianxin, et al.
Pubblicazione: (2024)

PeruMedQA: Benchmarking Large Language Models (LLMs) on Peruvian Medical Exams -- Dataset Construction and Evaluation
di: Carrillo-Larco, Rodrigo M., et al.
Pubblicazione: (2025)

Aqulia-Med LLM: Pioneering Full-Process Open-Source Medical Language Models
di: Zhao, Lulu, et al.
Pubblicazione: (2024)

MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoning
di: Tang, Xiangru, et al.
Pubblicazione: (2023)

MedREQAL: Examining Medical Knowledge Recall of Large Language Models via Question Answering
di: Vladika, Juraj, et al.
Pubblicazione: (2024)

DiversityMedQA: Assessing Demographic Biases in Medical Diagnosis using Large Language Models
di: Rawat, Rajat, et al.
Pubblicazione: (2024)

ChiMed 2.0: Advancing Chinese Medical Dataset in Facilitating Large Language Modeling
di: Tian, Yuanhe, et al.
Pubblicazione: (2025)

ControlMed: Adding Reasoning Control to Medical Language Model
di: Lee, Sung-Min, et al.
Pubblicazione: (2025)

MedArabiQ: Benchmarking Large Language Models on Arabic Medical Tasks
di: Daoud, Mouath Abu, et al.
Pubblicazione: (2025)

From Static Benchmarks to Dynamic Protocol: Agent-Centric Text Anomaly Detection for Evaluating LLM Reasoning
di: Yoa, Seungdong, et al.
Pubblicazione: (2026)

TemMed-Bench: Evaluating Temporal Medical Image Reasoning in Vision-Language Models
di: Zhang, Junyi, et al.
Pubblicazione: (2025)

MedCOD: Enhancing English-to-Spanish Medical Translation of Large Language Models Using Enriched Chain-of-Dictionary Framework
di: Salim, Md Shahidul, et al.
Pubblicazione: (2025)

CVE-LLM : Ontology-Assisted Automatic Vulnerability Evaluation Using Large Language Models
di: Ghosh, Rikhiya, et al.
Pubblicazione: (2025)

Position: Thematic Analysis of Unstructured Clinical Transcripts with Large Language Models
di: Yi, Seungjun, et al.
Pubblicazione: (2025)

DEP: A Decentralized Large Language Model Evaluation Protocol
di: Peng, Jianxiang, et al.
Pubblicazione: (2026)

Zero-shot Large Language Models for Automatic Readability Assessment
di: Grossman, Riley, et al.
Pubblicazione: (2026)

PerMedCQA: Benchmarking Large Language Models on Medical Consumer Question Answering in Persian Language
di: Jamali, Naghmeh, et al.
Pubblicazione: (2025)

Assessing Large Language Models for Medical QA: Zero-Shot and LLM-as-a-Judge Evaluation
di: Adib, Shefayat E Shams, et al.
Pubblicazione: (2026)

AutoMedPrompt: A New Framework for Optimizing LLM Medical Prompts Using Textual Gradients
di: Wu, Sean, et al.
Pubblicazione: (2025)