NeFF-BioNet: Crop Biomass Prediction from Point Cloud to Drone Imagery
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866913569002487808 |
|---|---|
| author | Li, Xuesong Hayder, Zeeshan Zia, Ali Cassidy, Connor Liu, Shiming Stiller, Warwick Stone, Eric Conaty, Warren Petersson, Lars Rolland, Vivien |
| author_facet | Li, Xuesong Hayder, Zeeshan Zia, Ali Cassidy, Connor Liu, Shiming Stiller, Warwick Stone, Eric Conaty, Warren Petersson, Lars Rolland, Vivien |
| contents | Crop biomass offers crucial insights into plant health and yield, making it essential for crop science, farming systems, and agricultural research. However, current measurement methods, which are labor-intensive, destructive, and imprecise, hinder large-scale quantification of this trait. To address this limitation, we present a biomass prediction network (BioNet), designed for adaptation across different data modalities, including point clouds and drone imagery. Our BioNet, utilizing a sparse 3D convolutional neural network (CNN) and a transformer-based prediction module, processes point clouds and other 3D data representations to predict biomass. To further extend BioNet for drone imagery, we integrate a neural feature field (NeFF) module, enabling 3D structure reconstruction and the transformation of 2D semantic features from vision foundation models into the corresponding 3D surfaces. For the point cloud modality, BioNet demonstrates superior performance on two public datasets, with an approximate 6.1% relative improvement (RI) over the state-of-the-art. In the RGB image modality, the combination of BioNet and NeFF achieves a 7.9% RI. Additionally, the NeFF-based approach utilizes inexpensive, portable drone-mounted cameras, providing a scalable solution for large field applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_23901 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | NeFF-BioNet: Crop Biomass Prediction from Point Cloud to Drone Imagery Li, Xuesong Hayder, Zeeshan Zia, Ali Cassidy, Connor Liu, Shiming Stiller, Warwick Stone, Eric Conaty, Warren Petersson, Lars Rolland, Vivien Computer Vision and Pattern Recognition Crop biomass offers crucial insights into plant health and yield, making it essential for crop science, farming systems, and agricultural research. However, current measurement methods, which are labor-intensive, destructive, and imprecise, hinder large-scale quantification of this trait. To address this limitation, we present a biomass prediction network (BioNet), designed for adaptation across different data modalities, including point clouds and drone imagery. Our BioNet, utilizing a sparse 3D convolutional neural network (CNN) and a transformer-based prediction module, processes point clouds and other 3D data representations to predict biomass. To further extend BioNet for drone imagery, we integrate a neural feature field (NeFF) module, enabling 3D structure reconstruction and the transformation of 2D semantic features from vision foundation models into the corresponding 3D surfaces. For the point cloud modality, BioNet demonstrates superior performance on two public datasets, with an approximate 6.1% relative improvement (RI) over the state-of-the-art. In the RGB image modality, the combination of BioNet and NeFF achieves a 7.9% RI. Additionally, the NeFF-based approach utilizes inexpensive, portable drone-mounted cameras, providing a scalable solution for large field applications. |
| title | NeFF-BioNet: Crop Biomass Prediction from Point Cloud to Drone Imagery |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2410.23901 |