Cover Image

MultiMedEval: A Benchmark and a Toolkit for Evaluating Medical Vision-Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Royer, Corentin, Menze, Bjoern, Sekuboyina, Anjany
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

DeViDe: Faceted medical knowledge for improved medical vision-language pre-training
by: Luo, Haozhe, et al.
Published: (2024)

RadDiagSeg-M: A Vision Language Model for Joint Diagnosis and Multi-Target Segmentation in Radiology
by: Li, Chengrun, et al.
Published: (2025)

MedFoundationHub: A Lightweight and Secure Toolkit for Deploying Medical Vision Language Foundation Models
by: Li, Xiao, et al.
Published: (2025)

Better Tokens for Better 3D: Advancing Vision-Language Modeling in 3D Medical Imaging
by: Hamamci, Ibrahim Ethem, et al.
Published: (2025)

Enhancing Interpretability of Vertebrae Fracture Grading using Human-interpretable Prototypes
by: Sinhamahapatra, Poulami, et al.
Published: (2024)

MultiMedVision: Multi-Modal Medical Vision Framework
by: Li, Frank, et al.
Published: (2026)

CT2Rep: Automated Radiology Report Generation for 3D Medical Imaging
by: Hamamci, Ibrahim Ethem, et al.
Published: (2024)

LLMC+: Benchmarking Vision-Language Model Compression with a Plug-and-play Toolkit
by: Lv, Chengtao, et al.
Published: (2025)

Med-StepBench: A Hierarchical Reasoning Framework for Evaluating Hallucinations in Medical Vision-Language Models
by: Nguyen, Minh Khoi, et al.
Published: (2026)

TemMed-Bench: Evaluating Temporal Medical Image Reasoning in Vision-Language Models
by: Zhang, Junyi, et al.
Published: (2025)

MedHEval: Benchmarking Hallucinations and Mitigation Strategies in Medical Large Vision-Language Models
by: Chang, Aofei, et al.
Published: (2025)

KorMedMCQA-V: A Multimodal Benchmark for Evaluating Vision-Language Models on the Korean Medical Licensing Examination
by: Choi, Byungjin, et al.
Published: (2026)

Enhancing Cardiovascular Disease Prediction through Multi-Modal Self-Supervised Learning
by: Girlanda, Francesco, et al.
Published: (2024)

Envisioning MedCLIP: A Deep Dive into Explainability for Medical Vision-Language Models
by: Hashmi, Anees Ur Rehman, et al.
Published: (2024)

VERIDAH: Solving Enumeration Anomaly Aware Vertebra Labeling across Imaging Sequences
by: Möller, Hendrik, et al.
Published: (2026)

GenerateCT: Text-Conditional Generation of 3D Chest CT Volumes
by: Hamamci, Ibrahim Ethem, et al.
Published: (2023)

MedHallTune: An Instruction-Tuning Benchmark for Mitigating Medical Hallucination in Vision-Language Models
by: Yan, Qiao, et al.
Published: (2025)

Hulu-Med: A Transparent Generalist Model towards Holistic Medical Vision-Language Understanding
by: Jiang, Songtao, et al.
Published: (2025)

Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Models
by: Lai, Yuxiang, et al.
Published: (2025)

MedFM-Robust: Benchmarking Robustness of Medical Foundation Models
by: Cui, Xiangxiang, et al.
Published: (2026)

MedVH: Towards Systematic Evaluation of Hallucination for Large Vision Language Models in the Medical Context
by: Gu, Zishan, et al.
Published: (2024)

Semantically Consistent Discrete Diffusion for 3D Biological Graph Modeling
by: Prabhakar, Chinmay, et al.
Published: (2025)

SPINEPS -- Automatic Whole Spine Segmentation of T2-weighted MR images using a Two-Phase Approach to Multi-class Semantic and Instance Segmentation
by: Möller, Hendrik, et al.
Published: (2024)

VSF-Med:A Vulnerability Scoring Framework for Medical Vision-Language Models
by: Sadanandan, Binesh, et al.
Published: (2025)

ThermEval: A Structured Benchmark for Evaluation of Vision-Language Models on Thermal Imagery
by: Shrivastava, Ayush, et al.
Published: (2026)

ProGiDiff: Prompt-Guided Diffusion-Based Medical Image Segmentation
by: Lin, Yuan, et al.
Published: (2026)

FairMedFM: Fairness Benchmarking for Medical Imaging Foundation Models
by: Jin, Ruinan, et al.
Published: (2024)

MultiVerse: A Multi-Turn Conversation Benchmark for Evaluating Large Vision and Language Models
by: Lee, Young-Jun, et al.
Published: (2025)

Med-VCD: Mitigating Hallucination for Medical Large Vision Language Models through Visual Contrastive Decoding
by: Mahdavi, Zahra, et al.
Published: (2025)

A Spectrum Evaluation Benchmark for Medical Multi-Modal Large Language Models
by: Liu, Jie, et al.
Published: (2024)

NPHardEval4V: Dynamic Evaluation of Large Vision-Language Models with Effects of Vision
by: Li, Xiang, et al.
Published: (2024)

Advancing Stroke Risk Prediction Using a Multi-modal Foundation Model
by: Delgrange, Camille, et al.
Published: (2024)

EvalCrafter: Benchmarking and Evaluating Large Video Generation Models
by: Liu, Yaofang, et al.
Published: (2023)

PSF-Med: Measuring and Explaining Paraphrase Sensitivity in Medical Vision Language Models
by: Sadanandan, Binesh, et al.
Published: (2026)

MedTri: A Platform for Structured Medical Report Normalization to Enhance Vision-Language Pretraining
by: Chu, Yuetan, et al.
Published: (2026)

QCalEval: Benchmarking Vision-Language Models for Quantum Calibration Plot Understanding
by: Cao, Shuxiang, et al.
Published: (2026)

MedKCO: Medical Vision-Language Pretraining via Knowledge-Driven Cognitive Orchestration
by: Zhang, Chenran, et al.
Published: (2026)

MedMoE: Modality-Specialized Mixture of Experts for Medical Vision-Language Understanding
by: Chopra, Shivang, et al.
Published: (2025)

MedFrameQA: A Multi-Image Medical VQA Benchmark for Clinical Reasoning
by: Yu, Suhao, et al.
Published: (2025)

Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Models
by: Jiang, Songtao, et al.
Published: (2024)