Cover Image

ProBench: Judging Multimodal Foundation Models on Open-ended Multi-domain Expert Tasks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yang, Yan, Li, Dongxu, Wu, Haoning, Chen, Bei, Liu, Liu, Pan, Liyuan, Li, Junnan
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understanding
by: Wu, Haoning, et al.
Published: (2024)

Aria: An Open Multimodal Native Mixture-of-Experts Model
by: Li, Dongxu, et al.
Published: (2024)

EZSR: Event-based Zero-Shot Recognition
by: Yang, Yan, et al.
Published: (2024)

VideoAutoArena: An Automated Arena for Evaluating Large Multimodal Models in Video Analysis through User Simulation
by: Luo, Ziyang, et al.
Published: (2024)

AesBench: An Expert Benchmark for Multimodal Large Language Models on Image Aesthetics Perception
by: Huang, Yipo, et al.
Published: (2024)

Intelligent Grimm -- Open-ended Visual Storytelling via Latent Diffusion Models
by: Liu, Chang, et al.
Published: (2023)

Towards Open-ended Visual Quality Comparison
by: Wu, Haoning, et al.
Published: (2024)

Q-Bench+: A Benchmark for Multi-modal Foundation Models on Low-level Vision from Single Images to Pairs
by: Zhang, Zicheng, et al.
Published: (2024)

OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generation
by: Zhou, Pengfei, et al.
Published: (2024)

Event Camera Data Dense Pre-training
by: Yang, Yan, et al.
Published: (2023)

Generative Frame Sampler for Long Video Understanding
by: Yao, Linli, et al.
Published: (2025)

ProBench: Benchmarking GUI Agents with Accurate Process Information
by: Yang, Leyang, et al.
Published: (2025)

VideoReasonBench: Can MLLMs Perform Vision-Centric Complex Video Reasoning?
by: Liu, Yuanxin, et al.
Published: (2025)

ProBench: Benchmarking Large Language Models in Competitive Programming
by: Yang, Lei, et al.
Published: (2025)

Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Vision
by: Wu, Haoning, et al.
Published: (2023)

OpenVLThinkerV2: A Generalist Multimodal Reasoning Model for Multi-domain Visual Tasks
by: Hu, Wenbo, et al.
Published: (2026)

SoccerMaster: A Vision Foundation Model for Soccer Understanding
by: Yang, Haolin, et al.
Published: (2025)

Storyboard guided Alignment for Fine-grained Video Action Recognition
by: Liu, Enqi, et al.
Published: (2024)

R-Bench: Are your Large Multimodal Model Robust to Real-world Corruptions?
by: Li, Chunyi, et al.
Published: (2024)

ST-BiBench: Benchmarking Multi-Stream Multimodal Coordination in Bimanual Embodied Tasks for MLLMs
by: Wu, Xin, et al.
Published: (2026)

Benchmarking and Improving GUI Agents in High-Dynamic Environments
by: Liu, Enqi, et al.
Published: (2026)

Intern-S1-Pro: Scientific Multimodal Foundation Model at Trillion Scale
by: Zou, Yicheng, et al.
Published: (2026)

MMRareBench: A Rare-Disease Multimodal and Multi-Image Medical Benchmark
by: Ning, Junzhi, et al.
Published: (2026)

ProJudge: A Multi-Modal Multi-Discipline Benchmark and Instruction-Tuning Dataset for MLLM-based Process Judges
by: Ai, Jiaxin, et al.
Published: (2025)

From Spots to Pixels: Dense Spatial Gene Expression Prediction from Histology Images
by: Zhang, Ruikun, et al.
Published: (2025)

Multi-Crit: Benchmarking Multimodal Judges on Pluralistic Criteria-Following
by: Xiong, Tianyi, et al.
Published: (2025)

Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillation
by: Li, Zhenxin, et al.
Published: (2024)

Count Anything at Any Granularity
by: Liu, Chang, et al.
Published: (2026)

LMHaze: Intensity-aware Image Dehazing with a Large-scale Multi-intensity Real Haze Dataset
by: Zhang, Ruikun, et al.
Published: (2024)

Q-Bench-Video: Benchmarking the Video Quality Understanding of LMMs
by: Zhang, Zicheng, et al.
Published: (2024)

FUSAR-KLIP: Towards Multimodal Foundation Models for Remote Sensing
by: Yang, Yi, et al.
Published: (2025)

Multi-Task Dense Prediction via Mixture of Low-Rank Experts
by: Yang, Yuqi, et al.
Published: (2024)

BriMA: Bridged Modality Adaptation for Multi-Modal Continual Action Quality Assessment
by: Zhou, Kanglei, et al.
Published: (2026)

MICON-Bench: Benchmarking and Enhancing Multi-Image Context Image Generation in Unified Multimodal Models
by: Wu, Mingrui, et al.
Published: (2026)

Med-RewardBench: Benchmarking Reward Models and Judges for Medical Multimodal Large Language Models
by: Ding, Meidan, et al.
Published: (2025)

End-to-end Open-vocabulary Video Visual Relationship Detection using Multi-modal Prompting
by: Wang, Yongqi, et al.
Published: (2024)

OIG-Bench: A Multi-Agent Annotated Benchmark for Multimodal One-Image Guides Understanding
by: Xie, Jiancong, et al.
Published: (2025)

A Preliminary Study on GPT-Image Generation Model for Image Restoration
by: Yang, Hao, et al.
Published: (2025)

A-Bench: Are LMMs Masters at Evaluating AI-generated Images?
by: Zhang, Zicheng, et al.
Published: (2024)

Seeing Through Fog: Towards Fog-Invariant Action Recognition
by: Liu, Enqi, et al.
Published: (2026)