VideoLoom: A Video Large Language Model for Joint Spatial-Temporal Understanding

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Shi, Jiapeng, Wang, Junke, You, Zuyao, He, Bo, Wu, Zuxuan
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914247801307136
author Shi, Jiapeng
Wang, Junke
You, Zuyao
He, Bo
Wu, Zuxuan
author_facet Shi, Jiapeng
Wang, Junke
You, Zuyao
He, Bo
Wu, Zuxuan
contents This paper presents VideoLoom, a unified Video Large Language Model (Video LLM) for joint spatial-temporal understanding. To facilitate the development of fine-grained spatial and temporal localization capabilities, we curate LoomData-8.7k, a human-centric video dataset with temporally grounded and spatially localized captions. With this, VideoLoom achieves state-of-the-art or highly competitive performance across a variety of spatial and temporal benchmarks (e.g., 63.1 J&F on ReVOS for referring video object segmentation, and 48.3 R1@0.7 on Charades-STA for temporal grounding). In addition, we introduce LoomBench, a novel benchmark consisting of temporal, spatial, and compositional video-question pairs, enabling a comprehensive evaluation of Video LLMs from diverse aspects. Collectively, these contributions offer a universal and effective suite for joint spatial-temporal video understanding, setting a new standard in multimodal intelligence.
format Preprint
id arxiv_https___arxiv_org_abs_2601_07290
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle VideoLoom: A Video Large Language Model for Joint Spatial-Temporal Understanding
Shi, Jiapeng
Wang, Junke
You, Zuyao
He, Bo
Wu, Zuxuan
Computer Vision and Pattern Recognition
This paper presents VideoLoom, a unified Video Large Language Model (Video LLM) for joint spatial-temporal understanding. To facilitate the development of fine-grained spatial and temporal localization capabilities, we curate LoomData-8.7k, a human-centric video dataset with temporally grounded and spatially localized captions. With this, VideoLoom achieves state-of-the-art or highly competitive performance across a variety of spatial and temporal benchmarks (e.g., 63.1 J&F on ReVOS for referring video object segmentation, and 48.3 R1@0.7 on Charades-STA for temporal grounding). In addition, we introduce LoomBench, a novel benchmark consisting of temporal, spatial, and compositional video-question pairs, enabling a comprehensive evaluation of Video LLMs from diverse aspects. Collectively, these contributions offer a universal and effective suite for joint spatial-temporal video understanding, setting a new standard in multimodal intelligence.
title VideoLoom: A Video Large Language Model for Joint Spatial-Temporal Understanding
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2601.07290