MVImgNet2.0: A Larger-scale Dataset of Multi-view Images

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Han, Xiaoguang, Wu, Yushuang, Shi, Luyue, Liu, Haolin, Liao, Hongjie, Qiu, Lingteng, Yuan, Weihao, Gu, Xiaodong, Dong, Zilong, Cui, Shuguang
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913594236469248
author Han, Xiaoguang
Wu, Yushuang
Shi, Luyue
Liu, Haolin
Liao, Hongjie
Qiu, Lingteng
Yuan, Weihao
Gu, Xiaodong
Dong, Zilong
Cui, Shuguang
author_facet Han, Xiaoguang
Wu, Yushuang
Shi, Luyue
Liu, Haolin
Liao, Hongjie
Qiu, Lingteng
Yuan, Weihao
Gu, Xiaodong
Dong, Zilong
Cui, Shuguang
contents MVImgNet is a large-scale dataset that contains multi-view images of ~220k real-world objects in 238 classes. As a counterpart of ImageNet, it introduces 3D visual signals via multi-view shooting, making a soft bridge between 2D and 3D vision. This paper constructs the MVImgNet2.0 dataset that expands MVImgNet into a total of ~520k objects and 515 categories, which derives a 3D dataset with a larger scale that is more comparable to ones in the 2D domain. In addition to the expanded dataset scale and category range, MVImgNet2.0 is of a higher quality than MVImgNet owing to four new features: (i) most shoots capture 360-degree views of the objects, which can support the learning of object reconstruction with completeness; (ii) the segmentation manner is advanced to produce foreground object masks of higher accuracy; (iii) a more powerful structure-from-motion method is adopted to derive the camera pose for each frame of a lower estimation error; (iv) higher-quality dense point clouds are reconstructed via advanced methods for objects captured in 360-degree views, which can serve for downstream applications. Extensive experiments confirm the value of the proposed MVImgNet2.0 in boosting the performance of large 3D reconstruction models. MVImgNet2.0 will be public at luyues.github.io/mvimgnet2, including multi-view images of all 520k objects, the reconstructed high-quality point clouds, and data annotation codes, hoping to inspire the broader vision community.
format Preprint
id arxiv_https___arxiv_org_abs_2412_01430
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle MVImgNet2.0: A Larger-scale Dataset of Multi-view Images
Han, Xiaoguang
Wu, Yushuang
Shi, Luyue
Liu, Haolin
Liao, Hongjie
Qiu, Lingteng
Yuan, Weihao
Gu, Xiaodong
Dong, Zilong
Cui, Shuguang
Computer Vision and Pattern Recognition
Artificial Intelligence
Graphics
MVImgNet is a large-scale dataset that contains multi-view images of ~220k real-world objects in 238 classes. As a counterpart of ImageNet, it introduces 3D visual signals via multi-view shooting, making a soft bridge between 2D and 3D vision. This paper constructs the MVImgNet2.0 dataset that expands MVImgNet into a total of ~520k objects and 515 categories, which derives a 3D dataset with a larger scale that is more comparable to ones in the 2D domain. In addition to the expanded dataset scale and category range, MVImgNet2.0 is of a higher quality than MVImgNet owing to four new features: (i) most shoots capture 360-degree views of the objects, which can support the learning of object reconstruction with completeness; (ii) the segmentation manner is advanced to produce foreground object masks of higher accuracy; (iii) a more powerful structure-from-motion method is adopted to derive the camera pose for each frame of a lower estimation error; (iv) higher-quality dense point clouds are reconstructed via advanced methods for objects captured in 360-degree views, which can serve for downstream applications. Extensive experiments confirm the value of the proposed MVImgNet2.0 in boosting the performance of large 3D reconstruction models. MVImgNet2.0 will be public at luyues.github.io/mvimgnet2, including multi-view images of all 520k objects, the reconstructed high-quality point clouds, and data annotation codes, hoping to inspire the broader vision community.
title MVImgNet2.0: A Larger-scale Dataset of Multi-view Images
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Graphics
url https://arxiv.org/abs/2412.01430