EventBench: Towards Comprehensive Benchmarking of Event-based MLLMs

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Liu, Shaoyu, Li, Jianing, Zhao, Guanghui, Zhang, Yunjian, Ji, Xiangyang
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908670902665216
author Liu, Shaoyu
Li, Jianing
Zhao, Guanghui
Zhang, Yunjian
Ji, Xiangyang
author_facet Liu, Shaoyu
Li, Jianing
Zhao, Guanghui
Zhang, Yunjian
Ji, Xiangyang
contents Multimodal large language models (MLLMs) have made significant advancements in event-based vision, yet the comprehensive evaluation of their capabilities within a unified benchmark remains largely unexplored. In this work, we introduce EventBench, a benchmark that offers eight diverse task metrics together with a large-scale event stream dataset. EventBench differs from existing event-based benchmarks in four key aspects: (1) openness in accessibility, releasing all raw event streams and task instructions across eight evaluation metrics; (2) diversity in task coverage, spanning understanding, recognition, and spatial reasoning tasks for comprehensive capability assessment; (3) integration in spatial dimensions, pioneering the design of 3D spatial reasoning tasks for event-based MLLMs; and (4) scale in data volume, with an accompanying training set of over one million event-text pairs supporting large-scale training and evaluation. Using EventBench, we evaluate state-of-the-art closed-source models such as GPT-5 and Gemini-2.5 Pro, leading open-source models including Qwen2.5-VL and InternVL3, and event-based MLLMs such as EventGPT that directly process raw event streams. Extensive evaluation reveals that while current event-based MLLMs demonstrate strong performance in event stream understanding, they continue to struggle with fine-grained recognition and spatial reasoning.
format Preprint
id arxiv_https___arxiv_org_abs_2511_18448
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle EventBench: Towards Comprehensive Benchmarking of Event-based MLLMs
Liu, Shaoyu
Li, Jianing
Zhao, Guanghui
Zhang, Yunjian
Ji, Xiangyang
Computer Vision and Pattern Recognition
Multimodal large language models (MLLMs) have made significant advancements in event-based vision, yet the comprehensive evaluation of their capabilities within a unified benchmark remains largely unexplored. In this work, we introduce EventBench, a benchmark that offers eight diverse task metrics together with a large-scale event stream dataset. EventBench differs from existing event-based benchmarks in four key aspects: (1) openness in accessibility, releasing all raw event streams and task instructions across eight evaluation metrics; (2) diversity in task coverage, spanning understanding, recognition, and spatial reasoning tasks for comprehensive capability assessment; (3) integration in spatial dimensions, pioneering the design of 3D spatial reasoning tasks for event-based MLLMs; and (4) scale in data volume, with an accompanying training set of over one million event-text pairs supporting large-scale training and evaluation. Using EventBench, we evaluate state-of-the-art closed-source models such as GPT-5 and Gemini-2.5 Pro, leading open-source models including Qwen2.5-VL and InternVL3, and event-based MLLMs such as EventGPT that directly process raw event streams. Extensive evaluation reveals that while current event-based MLLMs demonstrate strong performance in event stream understanding, they continue to struggle with fine-grained recognition and spatial reasoning.
title EventBench: Towards Comprehensive Benchmarking of Event-based MLLMs
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.18448