Saved in:
Bibliographic Details
Main Authors: Wang, Yunnan, Zheng, Kecheng, Wang, Jianyuan, Chen, Minghao, Novotny, David, Rupprecht, Christian, Xu, Yinghao, Zhu, Xing, Zeng, Wenjun, Jin, Xin, Shen, Yujun
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2604.07990
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • The convergence of 3D geometric perception and video synthesis has created an unprecedented demand for large-scale video data that is rich in both semantic and spatio-temporal information. While existing datasets have advanced either 3D understanding or video generation, a significant gap remains in providing a unified resource that supports both domains at scale. To bridge this chasm, we introduce SceneScribe-1M, a new large-scale, multi-modal video dataset. It comprises one million in-the-wild videos, each meticulously annotated with detailed textual descriptions, precise camera parameters, dense depth maps, and consistent 3D point tracks. We demonstrate the versatility and value of SceneScribe-1M by establishing benchmarks across a wide array of downstream tasks, including monocular depth estimation, scene reconstruction, and dynamic point tracking, as well as generative tasks such as text-to-video synthesis, with or without camera control. By open-sourcing SceneScribe-1M, we aim to provide a comprehensive benchmark and a catalyst for research, fostering the development of models that can both perceive the dynamic 3D world and generate controllable, realistic video content.