Cover Image

Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQA

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yan, Qianqi, He, Xuehai, Yue, Xiang, Wang, Xin Eric
Format:	Preprint
Published:	2024
Subjects:	Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Muffin or Chihuahua? Challenging Multimodal Large Language Models with Multipanel VQA
by: Fan, Yue, et al.
Published: (2024)

An Embarrassingly Simple Baseline for Imbalanced Semi-Supervised Learning
by: Chen, Hao, et al.
Published: (2022)

Multimodal Inconsistency Reasoning (MMIR): A New Benchmark for Multimodal Reasoning Models
by: Yan, Qianqi, et al.
Published: (2025)

Worse than Random: The Importance of a Baseline for Unsupervised Feature Selection
by: Rajabinasab, Muhammad, et al.
Published: (2026)

Bridging the Gap Between Multimodal Foundation Models and World Models
by: He, Xuehai
Published: (2025)

An Embarrassingly Simple Graph Heuristic Reveals Shortcut-Solvable Benchmarks for Sequential Recommendation
by: Han, Haoyu, et al.
Published: (2026)

An Embarrassingly Simple Defense Against LLM Abliteration Attacks
by: Shairah, Harethah Abu, et al.
Published: (2025)

Multimodal Retrieval-Augmented Generation with Large Language Models for Medical VQA
by: Karim, A H M Rezaul, et al.
Published: (2025)

Hidden in Plain Sight: Reasoning in Underspecified and Misspecified Scenarios for Multimodal LLMs
by: Yan, Qianqi, et al.
Published: (2025)

An Embarrassingly Simple Approach to Enhance Transformer Performance in Genomic Selection for Crop Breeding
by: Chen, Renqi, et al.
Published: (2024)

An Embarrassingly Simple Approach for LLM with Strong ASR Capacity
by: Ma, Ziyang, et al.
Published: (2024)

MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens
by: Zheng, Kaizhi, et al.
Published: (2023)

Architecting Clinical Collaboration: Multi-Agent Reasoning Systems for Multimodal Medical VQA
by: Thakrar, Karishma, et al.
Published: (2025)

KEPO: Knowledge-Enhanced Preference Optimization for Multimodal Reasoning with Applications to Medical VQA
by: Yang, Fan, et al.
Published: (2026)

Worse than Zero-shot? A Fact-Checking Dataset for Evaluating the Robustness of RAG Against Misleading Retrievals
by: Zeng, Linda, et al.
Published: (2025)

Causal Probing for Internal Visual Representations in Multimodal Large Language Models
by: Deng, Zehao, et al.
Published: (2026)

SAFER: Risk-Constrained Sample-then-Filter in Large Language Models
by: Wang, Qingni, et al.
Published: (2025)

LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Models
by: Ge, Qihang, et al.
Published: (2024)

From Attribution to Abstention: Training-Free Attention-Based Auditing for Clinical Summarization
by: Yan, Qianqi, et al.
Published: (2026)

"PhyWorldBench": A Comprehensive Evaluation of Physical Realism in Text-to-Video Models
by: Gu, Jing, et al.
Published: (2025)

Text-VQA Aug: Pipelined Harnessing of Large Multimodal Models for Automated Synthesis
by: Joshi, Soham, et al.
Published: (2025)

ComCLIP: Training-Free Compositional Image and Text Matching
by: Jiang, Kenan, et al.
Published: (2022)

MultiMedEdit: A Scenario-Aware Benchmark for Evaluating Knowledge Editing in Medical VQA
by: Wen, Shengtao, et al.
Published: (2025)

Better Accuracies, Worse Reasoning: A Step-Level Audit of Medical Chain-of-Thought Distillation
by: Jiang, Zhaoyang, et al.
Published: (2026)

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models
by: Zhang, Xiechi, et al.
Published: (2024)

SCRA-VQA: Summarized Caption-Rerank for Augmented Large Language Models in Visual Question Answering
by: Zhang, Yan, et al.
Published: (2025)

Evaluating the Impact of Post-Training Quantization on Reliable VQA with Multimodal LLMs
by: Kurz, Paul Jonas, et al.
Published: (2026)

Toward Effective Reinforcement Learning Fine-Tuning for Medical VQA in Vision-Language Models
by: Zhu, Wenhui, et al.
Published: (2025)

Soft Thinking: Unlocking the Reasoning Potential of LLMs in Continuous Concept Space
by: Zhang, Zhen, et al.
Published: (2025)

MedBookVQA: A Systematic and Comprehensive Medical Benchmark Derived from Open-Access Book
by: Yip, Sau Lai, et al.
Published: (2025)

Improving Automatic VQA Evaluation Using Large Language Models
by: Mañas, Oscar, et al.
Published: (2023)

Deterministic Hallucination Detection in Medical VQA via Confidence-Evidence Bayesian Gain
by: Asadi, Mohammad, et al.
Published: (2026)

A Simple Aerial Detection Baseline of Multimodal Language Models
by: Li, Qingyun, et al.
Published: (2025)

OmniTrace: A Unified Framework for Generation-Time Attribution in Omni-Modal LLMs
by: Yan, Qianqi, et al.
Published: (2026)

Evaluating Multimodal Large Language Models with Daily Composite Tasks in Home Environments
by: Zhang, Zhenliang, et al.
Published: (2025)

Auditing Frontier Vision-Language Models for Trustworthy Medical VQA: Grounding Failures, Format Collapse, and Domain Adaptation
by: Chen, Xupeng, et al.
Published: (2026)

Parameter-Efficient Fine-Tuning Medical Multimodal Large Language Models for Medical Visual Grounding
by: He, Jinlong, et al.
Published: (2024)

Hospitality-VQA: Decision-Oriented Informativeness Evaluation for Vision-Language Models
by: Lee, Jeongwoo, et al.
Published: (2026)

PeFoMed: Parameter Efficient Fine-tuning of Multimodal Large Language Models for Medical Imaging
by: He, Jinlong, et al.
Published: (2024)

MedMKEB: A Comprehensive Knowledge Editing Benchmark for Medical Multimodal Large Language Models
by: Xu, Dexuan, et al.
Published: (2025)