Evaluating the Ability of Large Language Models to Identify Adherence to CONSORT Reporting Guidelines in Randomized Controlled Trials: A Methodological Evaluation Study
Fuente:
arXiv
Saved in:
| Main Authors: | He, Zhichao, Bian, Mouxiao, Zhu, Jianhong, Chen, Jiayuan, Wang, Yunqiu, Zhao, Wenxia, Li, Tianbin, Han, Bing, Xu, Jie, Wu, Junyan |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Can Large Language Models Function as Qualified Pediatricians? A Systematic Evaluation in Real-World Clinical Contexts
by: Zhu, Siyu, et al.
Published: (2025)
by: Zhu, Siyu, et al.
Published: (2025)
Reporting of Complications in Rhinoplasty Randomized Controlled Trials: An Analysis Using the CONSORT Extension for Harms Checklist
by: Christian Hemmerich, et al.
Published: (2024)
by: Christian Hemmerich, et al.
Published: (2024)
Human-Level and Beyond: Benchmarking Large Language Models Against Clinical Pharmacists in Prescription Review
by: Yang, Yan, et al.
Published: (2025)
by: Yang, Yan, et al.
Published: (2025)
A Multi-faceted Analysis of Cognitive Abilities: Evaluating Prompt Methods with Large Language Models on the CONSORT Checklist
by: Jeon, Sohyeon, et al.
Published: (2025)
by: Jeon, Sohyeon, et al.
Published: (2025)
Principles and Guidelines for Randomized Controlled Trials in AI Evaluation
by: Kelly, Christopher, et al.
Published: (2026)
by: Kelly, Christopher, et al.
Published: (2026)
A Novel Ophthalmic Benchmark for Evaluating Multimodal Large Language Models with Fundus Photographs and OCT Images
by: Liang, Xiaoyi, et al.
Published: (2025)
by: Liang, Xiaoyi, et al.
Published: (2025)
Adherence to Minimum Information for Studies Evaluating Biologics in Orthopaedics Guidelines in Randomized Controlled Trials of Adipose‐derived Cells Therapies for Knee Osteoarthritis
by: Antonio Madrazo Ibarra, et al.
Published: (2025)
by: Antonio Madrazo Ibarra, et al.
Published: (2025)
MedBench v4: A Robust and Scalable Benchmark for Evaluating Chinese Medical Language Models, Multimodal Models, and Intelligent Agents
by: Ding, Jinru, et al.
Published: (2025)
by: Ding, Jinru, et al.
Published: (2025)
TCM-5CEval: Extended Deep Evaluation Benchmark for LLM's Comprehensive Clinical Research Competence in Traditional Chinese Medicine
by: Huang, Tianai, et al.
Published: (2025)
by: Huang, Tianai, et al.
Published: (2025)
GuidelineGuard: An Agentic Framework for Medical Note Evaluation with Guideline Adherence
by: Shahriyear, MD Ragib
Published: (2024)
by: Shahriyear, MD Ragib
Published: (2024)
MedCalc-Eval and MedCalc-Env: Advancing Medical Calculation Capabilities of Large Language Models
by: Mao, Kangkun, et al.
Published: (2025)
by: Mao, Kangkun, et al.
Published: (2025)
Evaluating the Pre-Consultation Ability of LLMs using Diagnostic Guidelines
by: Seo, Jean, et al.
Published: (2026)
by: Seo, Jean, et al.
Published: (2026)
Evaluation of Dietary Guideline Adherence and Risk of Sarcopenia in Elder Taiwanese
by: Yih‐Jin Liou, et al.
Published: (2025)
by: Yih‐Jin Liou, et al.
Published: (2025)
Building a Human-Verified Clinical Reasoning Dataset via a Human LLM Hybrid Pipeline for Trustworthy Medical AI
by: Ding, Chao, et al.
Published: (2025)
by: Ding, Chao, et al.
Published: (2025)
Adoption of a Drug Adherence App to Improve Medication Adherence: A Randomized Controlled Trial
by: Martin C. S. Wong, et al.
Published: (2026)
by: Martin C. S. Wong, et al.
Published: (2026)
Methodological Evaluation of Process-Control Systems Adoption in Rwanda: A Randomized Field Trial Approach
by: Ruzindana, Habyarimana, et al.
Published: (2007)
by: Ruzindana, Habyarimana, et al.
Published: (2007)
Benchmarking Ethical and Safety Risks of Healthcare LLMs in China-Toward Systemic Governance under Healthy China 2030
by: Bian, Mouxiao, et al.
Published: (2025)
by: Bian, Mouxiao, et al.
Published: (2025)
ChatGPT ‐4 in Nursing Research: A Methodological Evaluation of Bias Risk in Randomized Controlled Trials
by: Metin Tuncer, et al.
Published: (2025)
by: Metin Tuncer, et al.
Published: (2025)
Methodological Evaluation of Field Research Stations in Ghana: Randomized Trial for Efficiency Measurement
by: Agyei, Priscilla Ampomah, et al.
Published: (2005)
by: Agyei, Priscilla Ampomah, et al.
Published: (2005)
Methodological Evaluation of Emergency Care Units in Tanzania: A Randomized Field Trial
by: Mwakwayinda, Kamasi, et al.
Published: (2010)
by: Mwakwayinda, Kamasi, et al.
Published: (2010)
Reporting Quality of Clinical Trials on Platelet‐Rich Plasma for Low Back Pain: A Systematic Review of Adherence to Minimum Information for Studies Evaluating Biologics in Orthopaedics Guidelines
by: Daniel De La Huerta Meza, et al.
Published: (2025)
by: Daniel De La Huerta Meza, et al.
Published: (2025)
Evaluating Generative AI in the Lab: Methodological Challenges and Guidelines
by: Park, Hyerim, et al.
Published: (2026)
by: Park, Hyerim, et al.
Published: (2026)
Evaluating Websites for Older Adults: Adherence to "Senior-Friendly" Guidelines and End-User Performance
by: Hart, T. A., et al.
Published: (2008)
by: Hart, T. A., et al.
Published: (2008)
Comment on Armisen et al.: Methodological Considerations for MPO Inhibition Trials in MASH
by: Baodong Wang, et al.
Published: (2025)
by: Baodong Wang, et al.
Published: (2025)
Methodological Evaluation of Smallholder Farm Systems in Ethiopia: A Randomized Field Trial on Cost-Effectiveness
by: Gebru, Yared, et al.
Published: (2008)
by: Gebru, Yared, et al.
Published: (2008)
Evaluation of Municipal Water Systems in Ghana through Randomized Field Trials: A Methodological Assessment
by: Adutwum, Amma, et al.
Published: (2011)
by: Adutwum, Amma, et al.
Published: (2011)
Methodological Evaluation of District Hospitals Systems in Uganda: A Randomized Field Trial on System Reliability
by: Nsamba, Kabaka Namaganda, et al.
Published: (2014)
by: Nsamba, Kabaka Namaganda, et al.
Published: (2014)
Methodological Evaluation of District Hospitals Systems in Rwanda: A Randomized Field Trial on Clinical Outcomes
by: Bizimana, Inganwa, et al.
Published: (2014)
by: Bizimana, Inganwa, et al.
Published: (2014)
Evaluating Rural Clinics Systems in Ethiopia Through Randomized Field Trials: A Methodological Assessment
by: Afework, Mulugeta
Published: (2002)
by: Afework, Mulugeta
Published: (2002)
Methodological Evaluation of District Hospital Systems in Senegal: A Randomized Field Trial for Efficiency Gains
by: Sow, Seydi, et al.
Published: (2005)
by: Sow, Seydi, et al.
Published: (2005)
Methodological Evaluation of Water Treatment Systems in Tanzania: A Randomized Field Trial on System Reliability
by: Mwikarachwa, Mwihaki, et al.
Published: (2012)
by: Mwikarachwa, Mwihaki, et al.
Published: (2012)
Methodological Evaluation of Regional Monitoring Networks in Ethiopia: A Randomized Field Trial on Cost-Effectiveness
by: Tessema, Gebru
Published: (2001)
by: Tessema, Gebru
Published: (2001)
Methodological Evaluation of Secondary School Systems in Senegal: A Randomized Field Trial on System Reliability
by: Sarr, Mamadou, et al.
Published: (2007)
by: Sarr, Mamadou, et al.
Published: (2007)
Methodological Evaluation of Secondary Schools Systems in Senegal: A Randomized Field Trial on Adoption Rates
by: Diop, Oumar
Published: (2008)
by: Diop, Oumar
Published: (2008)
Methodological Evaluation of Municipal Water Systems in Uganda: Randomized Field Trial for Risk Reduction Assessment
by: Bintu, Kabaka, et al.
Published: (2011)
by: Bintu, Kabaka, et al.
Published: (2011)
Methodological Evaluation of Water Treatment Facilities Systems in Nigeria: Randomized Field Trial for Yield Improvement
by: Ifeakabwe, Chinedu
Published: (2009)
by: Ifeakabwe, Chinedu
Published: (2009)
Methodological Evaluation of Public Health Surveillance Systems in Ethiopia: A Randomized Field Trial Approach
by: Abera, Mekuria
Published: (2004)
by: Abera, Mekuria
Published: (2004)
Methodological Evaluation of Manufacturing Systems in Rwanda: A Randomized Field Trial for Cost-Efficiency Assessment
by: Prosper, Ingabiramana, et al.
Published: (2005)
by: Prosper, Ingabiramana, et al.
Published: (2005)
Methodological Evaluation of Public Health Surveillance Systems in Senegal: A Randomized Field Trial Approach
by: Diallo, Mamadou, et al.
Published: (2008)
by: Diallo, Mamadou, et al.
Published: (2008)
Methodological Evaluation of Maternal Care Facilities Systems in Nigeria: A Randomized Field Trial Approach
by: Olayiwola, Olalekan, et al.
Published: (2007)
by: Olayiwola, Olalekan, et al.
Published: (2007)
Similar Items
-
Can Large Language Models Function as Qualified Pediatricians? A Systematic Evaluation in Real-World Clinical Contexts
by: Zhu, Siyu, et al.
Published: (2025) -
Reporting of Complications in Rhinoplasty Randomized Controlled Trials: An Analysis Using the CONSORT Extension for Harms Checklist
by: Christian Hemmerich, et al.
Published: (2024) -
Human-Level and Beyond: Benchmarking Large Language Models Against Clinical Pharmacists in Prescription Review
by: Yang, Yan, et al.
Published: (2025) -
A Multi-faceted Analysis of Cognitive Abilities: Evaluating Prompt Methods with Large Language Models on the CONSORT Checklist
by: Jeon, Sohyeon, et al.
Published: (2025) -
Principles and Guidelines for Randomized Controlled Trials in AI Evaluation
by: Kelly, Christopher, et al.
Published: (2026)