WideRange4D: Enabling High-Quality 4D Reconstruction with Wide-Range Movements and Scenes

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Yang, Ling, Zhu, Kaixin, Tian, Juanxi, Zeng, Bohan, Lin, Mingbao, Pei, Hongjuan, Zhang, Wentao, Yan, Shuicheng
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909597465313280
author Yang, Ling
Zhu, Kaixin
Tian, Juanxi
Zeng, Bohan
Lin, Mingbao
Pei, Hongjuan
Zhang, Wentao
Yan, Shuicheng
author_facet Yang, Ling
Zhu, Kaixin
Tian, Juanxi
Zeng, Bohan
Lin, Mingbao
Pei, Hongjuan
Zhang, Wentao
Yan, Shuicheng
contents With the rapid development of 3D reconstruction technology, research in 4D reconstruction is also advancing, existing 4D reconstruction methods can generate high-quality 4D scenes. However, due to the challenges in acquiring multi-view video data, the current 4D reconstruction benchmarks mainly display actions performed in place, such as dancing, within limited scenarios. In practical scenarios, many scenes involve wide-range spatial movements, highlighting the limitations of existing 4D reconstruction datasets. Additionally, existing 4D reconstruction methods rely on deformation fields to estimate the dynamics of 3D objects, but deformation fields struggle with wide-range spatial movements, which limits the ability to achieve high-quality 4D scene reconstruction with wide-range spatial movements. In this paper, we focus on 4D scene reconstruction with significant object spatial movements and propose a novel 4D reconstruction benchmark, WideRange4D. This benchmark includes rich 4D scene data with large spatial variations, allowing for a more comprehensive evaluation of the generation capabilities of 4D generation methods. Furthermore, we introduce a new 4D reconstruction method, Progress4D, which generates stable and high-quality 4D results across various complex 4D scene reconstruction tasks. We conduct both quantitative and qualitative comparison experiments on WideRange4D, showing that our Progress4D outperforms existing state-of-the-art 4D reconstruction methods. Project: https://github.com/Gen-Verse/WideRange4D
format Preprint
id arxiv_https___arxiv_org_abs_2503_13435
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle WideRange4D: Enabling High-Quality 4D Reconstruction with Wide-Range Movements and Scenes
Yang, Ling
Zhu, Kaixin
Tian, Juanxi
Zeng, Bohan
Lin, Mingbao
Pei, Hongjuan
Zhang, Wentao
Yan, Shuicheng
Computer Vision and Pattern Recognition
With the rapid development of 3D reconstruction technology, research in 4D reconstruction is also advancing, existing 4D reconstruction methods can generate high-quality 4D scenes. However, due to the challenges in acquiring multi-view video data, the current 4D reconstruction benchmarks mainly display actions performed in place, such as dancing, within limited scenarios. In practical scenarios, many scenes involve wide-range spatial movements, highlighting the limitations of existing 4D reconstruction datasets. Additionally, existing 4D reconstruction methods rely on deformation fields to estimate the dynamics of 3D objects, but deformation fields struggle with wide-range spatial movements, which limits the ability to achieve high-quality 4D scene reconstruction with wide-range spatial movements. In this paper, we focus on 4D scene reconstruction with significant object spatial movements and propose a novel 4D reconstruction benchmark, WideRange4D. This benchmark includes rich 4D scene data with large spatial variations, allowing for a more comprehensive evaluation of the generation capabilities of 4D generation methods. Furthermore, we introduce a new 4D reconstruction method, Progress4D, which generates stable and high-quality 4D results across various complex 4D scene reconstruction tasks. We conduct both quantitative and qualitative comparison experiments on WideRange4D, showing that our Progress4D outperforms existing state-of-the-art 4D reconstruction methods. Project: https://github.com/Gen-Verse/WideRange4D
title WideRange4D: Enabling High-Quality 4D Reconstruction with Wide-Range Movements and Scenes
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.13435