CF-PRNet: Coarse-to-Fine Prototype Refining Network for Point Cloud Completion and Reconstruction

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Chen, Zhi, Wei, Tianqi, Zhao, Zecheng, Lim, Jia Syuen, Luo, Yadan, Zhang, Hu, Yu, Xin, Chapman, Scott, Huang, Zi
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866929499239612416
author Chen, Zhi
Wei, Tianqi
Zhao, Zecheng
Lim, Jia Syuen
Luo, Yadan
Zhang, Hu
Yu, Xin
Chapman, Scott
Huang, Zi
author_facet Chen, Zhi
Wei, Tianqi
Zhao, Zecheng
Lim, Jia Syuen
Luo, Yadan
Zhang, Hu
Yu, Xin
Chapman, Scott
Huang, Zi
contents In modern agriculture, precise monitoring of plants and fruits is crucial for tasks such as high-throughput phenotyping and automated harvesting. This paper addresses the challenge of reconstructing accurate 3D shapes of fruits from partial views, which is common in agricultural settings. We introduce CF-PRNet, a coarse-to-fine prototype refining network, leverages high-resolution 3D data during the training phase but requires only a single RGB-D image for real-time inference. Our approach begins by extracting the incomplete point cloud data that constructed from a partial view of a fruit with a series of convolutional blocks. The extracted features inform the generation of scaling vectors that refine two sequentially constructed 3D mesh prototypes - one coarse and one fine-grained. This progressive refinement facilitates the detailed completion of the final point clouds, achieving detailed and accurate reconstructions. CF-PRNet demonstrates excellent performance metrics with a Chamfer Distance of 3.78, an F1 Score of 66.76%, a Precision of 56.56%, and a Recall of 85.31%, and win the first place in the Shape Completion and Reconstruction of Sweet Peppers Challenge.
format Preprint
id arxiv_https___arxiv_org_abs_2409_08443
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle CF-PRNet: Coarse-to-Fine Prototype Refining Network for Point Cloud Completion and Reconstruction
Chen, Zhi
Wei, Tianqi
Zhao, Zecheng
Lim, Jia Syuen
Luo, Yadan
Zhang, Hu
Yu, Xin
Chapman, Scott
Huang, Zi
Computer Vision and Pattern Recognition
In modern agriculture, precise monitoring of plants and fruits is crucial for tasks such as high-throughput phenotyping and automated harvesting. This paper addresses the challenge of reconstructing accurate 3D shapes of fruits from partial views, which is common in agricultural settings. We introduce CF-PRNet, a coarse-to-fine prototype refining network, leverages high-resolution 3D data during the training phase but requires only a single RGB-D image for real-time inference. Our approach begins by extracting the incomplete point cloud data that constructed from a partial view of a fruit with a series of convolutional blocks. The extracted features inform the generation of scaling vectors that refine two sequentially constructed 3D mesh prototypes - one coarse and one fine-grained. This progressive refinement facilitates the detailed completion of the final point clouds, achieving detailed and accurate reconstructions. CF-PRNet demonstrates excellent performance metrics with a Chamfer Distance of 3.78, an F1 Score of 66.76%, a Precision of 56.56%, and a Recall of 85.31%, and win the first place in the Shape Completion and Reconstruction of Sweet Peppers Challenge.
title CF-PRNet: Coarse-to-Fine Prototype Refining Network for Point Cloud Completion and Reconstruction
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2409.08443