Copertina

CareMedEval dataset: Evaluating Critical Appraisal and Reasoning in the Biomedical Field

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Bonzi, Doria, Guiggi, Alexandre, Béchet, Frédéric, Ramisch, Carlos, Favre, Benoit
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Increasing faithfulness in human-human dialog summarization with Spoken Language Understanding tasks
di: Akani, Eunice, et al.
Pubblicazione: (2024)

MedMeta: A Benchmark for LLMs in Synthesizing Meta-Analysis Conclusion from Medical Studies
di: Ha, Huy Hoang, et al.
Pubblicazione: (2026)

CriticEval: Evaluating Large Language Model as Critic
di: Lan, Tian, et al.
Pubblicazione: (2024)

MedCalc-Eval and MedCalc-Env: Advancing Medical Calculation Capabilities of Large Language Models
di: Mao, Kangkun, et al.
Pubblicazione: (2025)

Evaluation of ChatGPT Family of Models for Biomedical Reasoning and Classification
di: Chen, Shan, et al.
Pubblicazione: (2023)

MedCritical: Enhancing Medical Reasoning in Small Language Models via Self-Collaborative Correction
di: Su, Xinchun, et al.
Pubblicazione: (2025)

MedHopQA: A Disease-Centered Multi-Hop Reasoning Benchmark and Evaluation Framework for LLM-Based Biomedical Question Answering
di: Islamaj, Rezarta, et al.
Pubblicazione: (2026)

MedConclusion: A Benchmark for Biomedical Conclusion Generation from Structured Abstracts
di: Li, Weiyue, et al.
Pubblicazione: (2026)

FairTranslate: An English-French Dataset for Gender Bias Evaluation in Machine Translation by Overcoming Gender Binarity
di: Jourdan, Fanny, et al.
Pubblicazione: (2025)

PatentEval: Understanding Errors in Patent Generation
di: Zuo, You, et al.
Pubblicazione: (2024)

SemEval-2024 Task 2: Safe Biomedical Natural Language Inference for Clinical Trials
di: Jullien, Mael, et al.
Pubblicazione: (2024)

MedAgentGym: A Scalable Agentic Training Environment for Code-Centric Reasoning in Biomedical Data Science
di: Xu, Ran, et al.
Pubblicazione: (2025)

Med-V1: Small Language Models for Zero-shot and Scalable Biomedical Evidence Attribution
di: Jin, Qiao, et al.
Pubblicazione: (2026)

StrucText-Eval: Evaluating Large Language Model's Reasoning Ability in Structure-Rich Text
di: Gu, Zhouhong, et al.
Pubblicazione: (2024)

WikiNER-fr-gold: A Gold-Standard NER Corpus
di: Cao, Danrun, et al.
Pubblicazione: (2024)

BioMedLM: A 2.7B Parameter Language Model Trained On Biomedical Text
di: Bolton, Elliot, et al.
Pubblicazione: (2024)

T2I-Eval-R1: Reinforcement Learning-Driven Reasoning for Interpretable Text-to-Image Evaluation
di: Ma, Zi-Ao, et al.
Pubblicazione: (2025)

Multi-LogiEval: Towards Evaluating Multi-Step Logical Reasoning Ability of Large Language Models
di: Patel, Nisarg, et al.
Pubblicazione: (2024)

FZI-WIM at SemEval-2024 Task 2: Self-Consistent CoT for Complex NLI in Biomedical Domain
di: Liu, Jin, et al.
Pubblicazione: (2024)

EmoLLM: Appraisal-Grounded Cognitive-Emotional Co-Reasoning in Large Language Models
di: Zhang, Yifei, et al.
Pubblicazione: (2026)

Fusion-Eval: Integrating Assistant Evaluators with LLMs
di: Shu, Lei, et al.
Pubblicazione: (2023)

CausalEval: Towards Better Causal Reasoning in Language Models
di: Yu, Longxuan, et al.
Pubblicazione: (2024)

EnigmaEval: A Benchmark of Long Multimodal Reasoning Challenges
di: Wang, Clinton J., et al.
Pubblicazione: (2025)

MedTrust-RAG: Evidence Verification and Trust Alignment for Biomedical Question Answering
di: Ning, Yingpeng, et al.
Pubblicazione: (2025)

MedMax: Mixed-Modal Instruction Tuning for Training Biomedical Assistants
di: Bansal, Hritik, et al.
Pubblicazione: (2024)

MedReason: Eliciting Factual Medical Reasoning Steps in LLMs via Knowledge Graphs
di: Wu, Juncheng, et al.
Pubblicazione: (2025)

Zero-Shot Commonsense Validation and Reasoning with Large Language Models: An Evaluation on SemEval-2020 Task 4 Dataset
di: Alfugaha, Rawand, et al.
Pubblicazione: (2025)

ReviewEval: An Evaluation Framework for AI-Generated Reviews
di: Garg, Madhav Krishan, et al.
Pubblicazione: (2025)

OpenMed NER: Open-Source, Domain-Adapted State-of-the-Art Transformers for Biomedical NER Across 12 Public Datasets
di: Panahi, Maziyar
Pubblicazione: (2025)

RealMedQA: A pilot biomedical question answering dataset containing realistic clinical questions
di: Kell, Gregory, et al.
Pubblicazione: (2024)

Condition-Gated Reasoning for Context-Dependent Biomedical Question Answering
di: Parekh, Jash Rajesh, et al.
Pubblicazione: (2026)

CURE-Med: Curriculum-Informed Reinforcement Learning for Multilingual Medical Reasoning
di: Onyame, Eric, et al.
Pubblicazione: (2026)

InfiMed: Low-Resource Medical MLLMs with Advancing Understanding and Reasoning
di: Liu, Zeyu, et al.
Pubblicazione: (2025)

TruthEval: A Dataset to Evaluate LLM Truthfulness and Reliability
di: Khatun, Aisha, et al.
Pubblicazione: (2024)

MTQ-Eval: Multilingual Text Quality Evaluation for Language Models
di: Pokharel, Rhitabrat, et al.
Pubblicazione: (2025)

EpiK-Eval: Evaluation for Language Models as Epistemic Models
di: Prato, Gabriele, et al.
Pubblicazione: (2023)

DivLogicEval: A Framework for Benchmarking Logical Reasoning Evaluation in Large Language Models
di: Chung, Tsz Ting, et al.
Pubblicazione: (2025)

MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoning
di: Tang, Xiangru, et al.
Pubblicazione: (2023)

SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning
di: Wang, Bin, et al.
Pubblicazione: (2023)

Evaluating Prompting Strategies with MedGemma for Medical Order Extraction
di: Balachandran, Abhinand, et al.
Pubblicazione: (2025)