DiVa-360: The Dynamic Visual Dataset for Immersive Neural Fields
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2023
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866909416230486016 |
|---|---|
| author | Lu, Cheng-You Zhou, Peisen Xing, Angela Pokhariya, Chandradeep Dey, Arnab Shah, Ishaan Mavidipalli, Rugved Hu, Dylan Comport, Andrew Chen, Kefan Sridhar, Srinath |
| author_facet | Lu, Cheng-You Zhou, Peisen Xing, Angela Pokhariya, Chandradeep Dey, Arnab Shah, Ishaan Mavidipalli, Rugved Hu, Dylan Comport, Andrew Chen, Kefan Sridhar, Srinath |
| contents | Advances in neural fields are enabling high-fidelity capture of the shape and appearance of dynamic 3D scenes. However, their capabilities lag behind those offered by conventional representations such as 2D videos because of algorithmic challenges and the lack of large-scale multi-view real-world datasets. We address the dataset limitation with DiVa-360, a real-world 360 dynamic visual dataset that contains synchronized high-resolution and long-duration multi-view video sequences of table-scale scenes captured using a customized low-cost system with 53 cameras. It contains 21 object-centric sequences categorized by different motion types, 25 intricate hand-object interaction sequences, and 8 long-duration sequences for a total of 17.4 M image frames. In addition, we provide foreground-background segmentation masks, synchronized audio, and text descriptions. We benchmark the state-of-the-art dynamic neural field methods on DiVa-360 and provide insights about existing methods and future challenges on long-duration neural field capture. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2307_16897 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | DiVa-360: The Dynamic Visual Dataset for Immersive Neural Fields Lu, Cheng-You Zhou, Peisen Xing, Angela Pokhariya, Chandradeep Dey, Arnab Shah, Ishaan Mavidipalli, Rugved Hu, Dylan Comport, Andrew Chen, Kefan Sridhar, Srinath Computer Vision and Pattern Recognition Artificial Intelligence Advances in neural fields are enabling high-fidelity capture of the shape and appearance of dynamic 3D scenes. However, their capabilities lag behind those offered by conventional representations such as 2D videos because of algorithmic challenges and the lack of large-scale multi-view real-world datasets. We address the dataset limitation with DiVa-360, a real-world 360 dynamic visual dataset that contains synchronized high-resolution and long-duration multi-view video sequences of table-scale scenes captured using a customized low-cost system with 53 cameras. It contains 21 object-centric sequences categorized by different motion types, 25 intricate hand-object interaction sequences, and 8 long-duration sequences for a total of 17.4 M image frames. In addition, we provide foreground-background segmentation masks, synchronized audio, and text descriptions. We benchmark the state-of-the-art dynamic neural field methods on DiVa-360 and provide insights about existing methods and future challenges on long-duration neural field capture. |
| title | DiVa-360: The Dynamic Visual Dataset for Immersive Neural Fields |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence |
| url | https://arxiv.org/abs/2307.16897 |