ViVo: A Dataset for Volumetric Video Reconstruction and Compression

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Azzarelli, Adrian, Gao, Ge, Kwan, Ho Man, Zhang, Fan, Anantrasirichai, Nantheera, Moolan-Feroze, Ollie, Bull, David
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917426772312064
author Azzarelli, Adrian
Gao, Ge
Kwan, Ho Man
Zhang, Fan
Anantrasirichai, Nantheera
Moolan-Feroze, Ollie
Bull, David
author_facet Azzarelli, Adrian
Gao, Ge
Kwan, Ho Man
Zhang, Fan
Anantrasirichai, Nantheera
Moolan-Feroze, Ollie
Bull, David
contents As research on neural volumetric video reconstruction and compression flourishes, there is a need for diverse and realistic datasets, which can be used to develop and validate reconstruction and compression models. However, existing volumetric video datasets lack diverse content in terms of both semantic and low-level features that are commonly present in real-world production pipelines. In this context, we propose a new dataset, ViVo, for VolumetrIc VideO reconstruction and compression. The dataset is faithful to real-world volumetric video production and is the first dataset to extend the definition of diversity to include both human-centric characteristics (skin, hair, etc.) and dynamic visual phenomena (transparent, reflective, liquid, etc.). Each video sequence in this database contains raw data including fourteen multi-view RGB and depth video pairs, synchronized at 30FPS with per-frame calibration and audio data, and their associated 2-D foreground masks and 3-D point clouds. To demonstrate the use of this database, we have benchmarked three state-of-the-art (SotA) 3-D reconstruction methods and two volumetric video compression algorithms. The obtained results evidence the challenging nature of the proposed dataset and the limitations of existing datasets for both volumetric video reconstruction and compression tasks, highlighting the need to develop more effective algorithms for these applications. The database and the associated results are available at https://vivo-bvicr.github.io/
format Preprint
id arxiv_https___arxiv_org_abs_2506_00558
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ViVo: A Dataset for Volumetric Video Reconstruction and Compression
Azzarelli, Adrian
Gao, Ge
Kwan, Ho Man
Zhang, Fan
Anantrasirichai, Nantheera
Moolan-Feroze, Ollie
Bull, David
Computer Vision and Pattern Recognition
As research on neural volumetric video reconstruction and compression flourishes, there is a need for diverse and realistic datasets, which can be used to develop and validate reconstruction and compression models. However, existing volumetric video datasets lack diverse content in terms of both semantic and low-level features that are commonly present in real-world production pipelines. In this context, we propose a new dataset, ViVo, for VolumetrIc VideO reconstruction and compression. The dataset is faithful to real-world volumetric video production and is the first dataset to extend the definition of diversity to include both human-centric characteristics (skin, hair, etc.) and dynamic visual phenomena (transparent, reflective, liquid, etc.). Each video sequence in this database contains raw data including fourteen multi-view RGB and depth video pairs, synchronized at 30FPS with per-frame calibration and audio data, and their associated 2-D foreground masks and 3-D point clouds. To demonstrate the use of this database, we have benchmarked three state-of-the-art (SotA) 3-D reconstruction methods and two volumetric video compression algorithms. The obtained results evidence the challenging nature of the proposed dataset and the limitations of existing datasets for both volumetric video reconstruction and compression tasks, highlighting the need to develop more effective algorithms for these applications. The database and the associated results are available at https://vivo-bvicr.github.io/
title ViVo: A Dataset for Volumetric Video Reconstruction and Compression
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.00558