Copertina

TempCore: Are Video QA Benchmarks Temporally Grounded? A Frame Selection Sensitivity Analysis and Benchmark

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Ok, Hyunjong, Lee, Jaeho
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computer Vision and Pattern Recognition Computation and Language Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Understanding the Effects of Distractors on Reasoning Vision-Language Models
di: Bae, Jiyun, et al.
Pubblicazione: (2025)

S2Cap: A Benchmark and a Baseline for Singing Style Captioning
di: Ok, Hyunjong, et al.
Pubblicazione: (2024)

Lost in the Prompt Order: Revealing the Limitations of Causal Attention in Language Models
di: Ok, Hyunjong, et al.
Pubblicazione: (2026)

Perception Test 2024: Challenge Summary and a Novel Hour-Long VideoQA Benchmark
di: Heyward, Joseph, et al.
Pubblicazione: (2024)

TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models
di: Cai, Mu, et al.
Pubblicazione: (2024)

LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understanding
di: Wu, Haoning, et al.
Pubblicazione: (2024)

MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understanding
di: Zuo, Yuxin, et al.
Pubblicazione: (2025)

GSR-BENCH: A Benchmark for Grounded Spatial Reasoning Evaluation via Multimodal LLMs
di: Rajabi, Navid, et al.
Pubblicazione: (2024)

NeuroQA: A Large-Scale Image-Grounded Benchmark for 3D Brain MRI Understanding
di: Abbasi, Mohammad H., et al.
Pubblicazione: (2026)

A Shortcut-aware Video-QA Benchmark for Physical Understanding via Minimal Video Pairs
di: Krojer, Benno, et al.
Pubblicazione: (2025)

MedFrameQA: A Multi-Image Medical VQA Benchmark for Clinical Reasoning
di: Yu, Suhao, et al.
Pubblicazione: (2025)

Benchmarking Graph Neural Networks for Document Layout Analysis in Public Affairs
di: Lopez-Duran, Miguel, et al.
Pubblicazione: (2025)

Imagine to Hear: Auditory Knowledge Generation can be an Effective Assistant for Language Models
di: Yoo, Suho, et al.
Pubblicazione: (2025)

Speculative End-Turn Detector for Efficient Speech Chatbot Assistant
di: Ok, Hyunjong, et al.
Pubblicazione: (2025)

Everything is a Video: Unifying Modalities through Next-Frame Prediction
di: Hudson, G. Thomas, et al.
Pubblicazione: (2024)

Reefknot: A Comprehensive Benchmark for Relation Hallucination Evaluation, Analysis and Mitigation in Multimodal Large Language Models
di: Zheng, Kening, et al.
Pubblicazione: (2024)

PerceptionComp: A Video Benchmark for Complex Perception-Centric Reasoning
di: Li, Shaoxuan, et al.
Pubblicazione: (2026)

360VFI: A Dataset and Benchmark for Omnidirectional Video Frame Interpolation
di: Lu, Wenxuan, et al.
Pubblicazione: (2024)

Reversed in Time: A Novel Temporal-Emphasized Benchmark for Cross-Modal Video-Text Retrieval
di: Du, Yang, et al.
Pubblicazione: (2024)

Cross-modal Causal Relation Alignment for Video Question Grounding
di: Chen, Weixing, et al.
Pubblicazione: (2025)

AuditoryBench++: Can Language Models Understand Auditory Knowledge without Hearing?
di: Ok, Hyunjong, et al.
Pubblicazione: (2025)

DAM: Dynamic Adapter Merging for Continual Video QA Learning
di: Cheng, Feng, et al.
Pubblicazione: (2024)

ATR-Bench: A Federated Learning Benchmark for Adaptation, Trust, and Reasoning
di: Ashraf, Tajamul, et al.
Pubblicazione: (2025)

Answering Questions in Stages: Prompt Chaining for Contract QA
di: Roegiest, Adam, et al.
Pubblicazione: (2024)

MORSE-500: A Programmatically Controllable Video Benchmark to Stress-Test Multimodal Reasoning
di: Cai, Zikui, et al.
Pubblicazione: (2025)

CAPability: A Comprehensive Visual Caption Benchmark for Evaluating Both Correctness and Thoroughness
di: Liu, Zhihang, et al.
Pubblicazione: (2025)

Movie Facts and Fibs (MF$^2$): A Benchmark for Long Movie Understanding
di: Zaranis, Emmanouil, et al.
Pubblicazione: (2025)

Rethinking Comprehensive Benchmark for Chart Understanding: A Perspective from Scientific Literature
di: Shen, Lingdong, et al.
Pubblicazione: (2024)

DialectGen: Benchmarking and Improving Dialect Robustness in Multimodal Generation
di: Zhou, Yu, et al.
Pubblicazione: (2025)

Benchmarking Vision-Language Models for French PDF-to-Markdown Conversion
di: Rigal, Bruno, et al.
Pubblicazione: (2026)

FigCaps-HF: A Figure-to-Caption Generative Framework and Benchmark with Human Feedback
di: Singh, Ashish, et al.
Pubblicazione: (2023)

T2VTextBench: A Human Evaluation Benchmark for Textual Control in Video Generation Models
di: Guo, Xuyang, et al.
Pubblicazione: (2025)

T2VPhysBench: A First-Principles Benchmark for Physical Consistency in Text-to-Video Generation
di: Guo, Xuyang, et al.
Pubblicazione: (2025)

T$^3$Bench: Benchmarking Current Progress in Text-to-3D Generation
di: He, Yuze, et al.
Pubblicazione: (2023)

MulTaBench: Benchmarking Multimodal Tabular Learning with Text and Image
di: Arazi, Alan, et al.
Pubblicazione: (2026)

LongVALE: Vision-Audio-Language-Event Benchmark Towards Time-Aware Omni-Modal Perception of Long Videos
di: Geng, Tiantian, et al.
Pubblicazione: (2024)

Roboflow100-VL: A Multi-Domain Object Detection Benchmark for Vision-Language Models
di: Robicheaux, Peter, et al.
Pubblicazione: (2025)

MMIE: Massive Multimodal Interleaved Comprehension Benchmark for Large Vision-Language Models
di: Xia, Peng, et al.
Pubblicazione: (2024)

VideoGEM: Training-free Action Grounding in Videos
di: Vogel, Felix, et al.
Pubblicazione: (2025)

Vinoground: Scrutinizing LMMs over Dense Temporal Reasoning with Short Videos
di: Zhang, Jianrui, et al.
Pubblicazione: (2024)