DSI-Bench: A Benchmark for Dynamic Spatial Intelligence
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866918165173239808 |
|---|---|
| author | Zhang, Ziang Wang, Zehan Zhang, Guanghao Dai, Weilong Xia, Yan Yan, Ziang Hong, Minjie Zhao, Zhou |
| author_facet | Zhang, Ziang Wang, Zehan Zhang, Guanghao Dai, Weilong Xia, Yan Yan, Ziang Hong, Minjie Zhao, Zhou |
| contents | Reasoning about dynamic spatial relationships is essential, as both observers and objects often move simultaneously. Although vision-language models (VLMs) and visual expertise models excel in 2D tasks and static scenarios, their ability to fully understand dynamic 3D scenarios remains limited. We introduce Dynamic Spatial Intelligence and propose DSI-Bench, a benchmark with nearly 1,000 dynamic videos and over 1,700 manually annotated questions covering nine decoupled motion patterns of observers and objects. Spatially and temporally symmetric designs reduce biases and enable systematic evaluation of models' reasoning about self-motion and object motion. Our evaluation of 14 VLMs and expert models reveals key limitations: models often conflate observer and object motion, exhibit semantic biases, and fail to accurately infer relative relationships in dynamic scenarios. Our DSI-Bench provides valuable findings and insights about the future development of general and expertise models with dynamic spatial intelligence. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_18873 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | DSI-Bench: A Benchmark for Dynamic Spatial Intelligence Zhang, Ziang Wang, Zehan Zhang, Guanghao Dai, Weilong Xia, Yan Yan, Ziang Hong, Minjie Zhao, Zhou Computer Vision and Pattern Recognition Reasoning about dynamic spatial relationships is essential, as both observers and objects often move simultaneously. Although vision-language models (VLMs) and visual expertise models excel in 2D tasks and static scenarios, their ability to fully understand dynamic 3D scenarios remains limited. We introduce Dynamic Spatial Intelligence and propose DSI-Bench, a benchmark with nearly 1,000 dynamic videos and over 1,700 manually annotated questions covering nine decoupled motion patterns of observers and objects. Spatially and temporally symmetric designs reduce biases and enable systematic evaluation of models' reasoning about self-motion and object motion. Our evaluation of 14 VLMs and expert models reveals key limitations: models often conflate observer and object motion, exhibit semantic biases, and fail to accurately infer relative relationships in dynamic scenarios. Our DSI-Bench provides valuable findings and insights about the future development of general and expertise models with dynamic spatial intelligence. |
| title | DSI-Bench: A Benchmark for Dynamic Spatial Intelligence |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2510.18873 |