Multi-Crit: Benchmarking Multimodal Judges on Pluralistic Criteria-Following
Fuente:
arXiv
Saved in:
| Main Authors: | Xiong, Tianyi, Ge, Yi, Li, Ming, Zhang, Zuolong, Kulkarni, Pranav, Wang, Kaishen, He, Qi, Zhu, Zeying, Liu, Chenxi, Chen, Ruibo, Zheng, Tong, Chen, Yanshuo, Wang, Xiyao, Zhang, Renrui, Chen, Wenhu, Huang, Heng |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Learning from Self-Debate: Preparing Reasoning Models for Multi-Agent Debate
by: Liu, Chenxi, et al.
Published: (2026)
by: Liu, Chenxi, et al.
Published: (2026)
ImAgent: A Unified Multimodal Agent Framework for Test-Time Scalable Image Generation
by: Wang, Kaishen, et al.
Published: (2025)
by: Wang, Kaishen, et al.
Published: (2025)
Modality-Balancing Preference Optimization of Large Multimodal Models by Adversarial Negative Mining
by: Liu, Chenxi, et al.
Published: (2025)
by: Liu, Chenxi, et al.
Published: (2025)
A Watermark for Order-Agnostic Language Models
by: Chen, Ruibo, et al.
Published: (2024)
by: Chen, Ruibo, et al.
Published: (2024)
Unsafe by Reciprocity: How Generation-Understanding Coupling Undermines Safety in Unified Multimodal Models
by: Wang, Kaishen, et al.
Published: (2026)
by: Wang, Kaishen, et al.
Published: (2026)
Towards Copyright Protection for Knowledge Bases of Retrieval-augmented Language Models via Reasoning
by: Guo, Junfeng, et al.
Published: (2025)
by: Guo, Junfeng, et al.
Published: (2025)
Few-Shot Class Incremental Learning with Attention-Aware Self-Adaptive Prompt
by: Liu, Chenxi, et al.
Published: (2024)
by: Liu, Chenxi, et al.
Published: (2024)
Distortion-free Watermarks are not Truly Distortion-free under Watermark Key Collisions
by: Wu, Yihan, et al.
Published: (2024)
by: Wu, Yihan, et al.
Published: (2024)
LLaVA-Critic: Learning to Evaluate Multimodal Models
by: Xiong, Tianyi, et al.
Published: (2024)
by: Xiong, Tianyi, et al.
Published: (2024)
Quantifying the Gap between Understanding and Generation within Unified Multimodal Models
by: Wang, Chenlong, et al.
Published: (2026)
by: Wang, Chenlong, et al.
Published: (2026)
Electrocatalytic Reduction of CO 2 to Ethylene: Catalyst Design and Synchrotron‐Based Characterizations
by: Meng Zhang, et al.
Published: (2026)
by: Meng Zhang, et al.
Published: (2026)
Your Vision-Language Model Itself Is a Strong Filter: Towards High-Quality Instruction Tuning with Data Selection
by: Chen, Ruibo, et al.
Published: (2024)
by: Chen, Ruibo, et al.
Published: (2024)
Fast and scalable Wasserstein-1 neural optimal transport solver for single-cell perturbation prediction
by: Chen, Yanshuo, et al.
Published: (2024)
by: Chen, Yanshuo, et al.
Published: (2024)
CodeJudge: Evaluating Code Generation with Large Language Models
by: Tong, Weixi, et al.
Published: (2024)
by: Tong, Weixi, et al.
Published: (2024)
Zer0-Jack: A Memory-efficient Gradient-based Jailbreaking Method for Black-box Multi-modal Large Language Models
by: Chen, Tiejin, et al.
Published: (2024)
by: Chen, Tiejin, et al.
Published: (2024)
ViCrit: A Verifiable Reinforcement Learning Proxy Task for Visual Perception in VLMs
by: Wang, Xiyao, et al.
Published: (2025)
by: Wang, Xiyao, et al.
Published: (2025)
Creative Belonging
by: Zhang, Yanshuo
Published: (2026)
by: Zhang, Yanshuo
Published: (2026)
Creative Belonging
by: Zhang, Yanshuo
Published: (2026)
by: Zhang, Yanshuo
Published: (2026)
MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria
by: Ge, Wentao, et al.
Published: (2023)
by: Ge, Wentao, et al.
Published: (2023)
From Lists to Emojis: How Format Bias Affects Model Alignment
by: Zhang, Xuanchang, et al.
Published: (2024)
by: Zhang, Xuanchang, et al.
Published: (2024)
MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmark
by: Chen, Dongping, et al.
Published: (2024)
by: Chen, Dongping, et al.
Published: (2024)
LLMs Improving LLMs: Agentic Discovery for Test-Time Scaling
by: Zheng, Tong, et al.
Published: (2026)
by: Zheng, Tong, et al.
Published: (2026)
MAmmoTH2: Scaling Instructions from the Web
by: Yue, Xiang, et al.
Published: (2024)
by: Yue, Xiang, et al.
Published: (2024)
How to QuantCrit
by: Castillo, Wendy, et al.
Published: (2024)
by: Castillo, Wendy, et al.
Published: (2024)
BadJudge: Backdoor Vulnerabilities of LLM-as-a-Judge
by: Tong, Terry, et al.
Published: (2025)
by: Tong, Terry, et al.
Published: (2025)
MedTVT-R1: A Multimodal LLM Empowering Medical Reasoning and Diagnosis
by: Zhang, Yuting, et al.
Published: (2025)
by: Zhang, Yuting, et al.
Published: (2025)
What makes Reasoning Models Different? Follow the Reasoning Leader for Efficient Decoding
by: Li, Ming, et al.
Published: (2025)
by: Li, Ming, et al.
Published: (2025)
OmniEdit: Building Image Editing Generalist Models Through Specialist Supervision
by: Wei, Cong, et al.
Published: (2024)
by: Wei, Cong, et al.
Published: (2024)
ABC: Achieving Better Control of Multimodal Embeddings using VLMs
by: Schneider, Benjamin, et al.
Published: (2025)
by: Schneider, Benjamin, et al.
Published: (2025)
Relative Difference sets from Almost Perfect Nonlinear Functions
by: Wang, Zeying
Published: (2026)
by: Wang, Zeying
Published: (2026)
X-Mark: Saliency-Guided Robust Dataset Ownership Verification for Medical Imaging
by: Kulkarni, Pranav, et al.
Published: (2026)
by: Kulkarni, Pranav, et al.
Published: (2026)
MR. Judge: Multimodal Reasoner as a Judge
by: Pi, Renjie, et al.
Published: (2025)
by: Pi, Renjie, et al.
Published: (2025)
Routing to the Right Expertise: A Trustworthy Judge for Instruction-based Image Editing
by: Sun, Chenxi, et al.
Published: (2025)
by: Sun, Chenxi, et al.
Published: (2025)
A Self-Correcting Vision-Language-Action Model for Fast and Slow System Manipulation
by: Li, Chenxuan, et al.
Published: (2024)
by: Li, Chenxuan, et al.
Published: (2024)
ProCrit: Self-Elicited Multi-Perspective Reasoning with Critic-Guided Revision for Multimodal Sarcasm Detection
by: Xu, Yingjia, et al.
Published: (2026)
by: Xu, Yingjia, et al.
Published: (2026)
SPICA: Retrieving Scenarios for Pluralistic In-Context Alignment
by: Chen, Quan Ze, et al.
Published: (2024)
by: Chen, Quan Ze, et al.
Published: (2024)
LLaVA-Critic-R1: Your Critic Model is Secretly a Strong Policy Model
by: Wang, Xiyao, et al.
Published: (2025)
by: Wang, Xiyao, et al.
Published: (2025)
A Prediction-as-Perception Framework for 3D Object Detection
by: Zhang, Song, et al.
Published: (2026)
by: Zhang, Song, et al.
Published: (2026)
Model Correlation Detection via Random Selection Probing
by: Chen, Ruibo, et al.
Published: (2025)
by: Chen, Ruibo, et al.
Published: (2025)
Taming Video Models for 3D and 4D Generation via Zero-Shot Camera Control
by: Song, Chenxi, et al.
Published: (2025)
by: Song, Chenxi, et al.
Published: (2025)
Similar Items
-
Learning from Self-Debate: Preparing Reasoning Models for Multi-Agent Debate
by: Liu, Chenxi, et al.
Published: (2026) -
ImAgent: A Unified Multimodal Agent Framework for Test-Time Scalable Image Generation
by: Wang, Kaishen, et al.
Published: (2025) -
Modality-Balancing Preference Optimization of Large Multimodal Models by Adversarial Negative Mining
by: Liu, Chenxi, et al.
Published: (2025) -
A Watermark for Order-Agnostic Language Models
by: Chen, Ruibo, et al.
Published: (2024) -
Unsafe by Reciprocity: How Generation-Understanding Coupling Undermines Safety in Unified Multimodal Models
by: Wang, Kaishen, et al.
Published: (2026)