Crossmodal learning for Crop Canopy Trait Estimation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ayanlade, Timilehin T., Powadi, Anirudha, Jubery, Talukder Z., Ganapathysubramanian, Baskar, Sarkar, Soumik
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915628175065088
author Ayanlade, Timilehin T.
Powadi, Anirudha
Jubery, Talukder Z.
Ganapathysubramanian, Baskar
Sarkar, Soumik
author_facet Ayanlade, Timilehin T.
Powadi, Anirudha
Jubery, Talukder Z.
Ganapathysubramanian, Baskar
Sarkar, Soumik
contents Recent advances in plant phenotyping have driven widespread adoption of multi sensor platforms for collecting crop canopy reflectance data. This includes the collection of heterogeneous data across multiple platforms, with Unmanned Aerial Vehicles (UAV) seeing significant usage due to their high performance in crop monitoring, forecasting, and prediction tasks. Similarly, satellite missions have been shown to be effective for agriculturally relevant tasks. In contrast to UAVs, such missions are bound to the limitation of spatial resolution, which hinders their effectiveness for modern farming systems focused on micro-plot management. In this work, we propose a cross modal learning strategy that enriches high-resolution satellite imagery with UAV level visual detail for crop canopy trait estimation. Using a dataset of approximately co registered satellite UAV image pairs collected from replicated plots of 84 hybrid maize varieties across five distinct locations in the U.S. Corn Belt, we train a model that learns fine grained spectral spatial correspondences between sensing modalities. Results show that the generated UAV-like representations from satellite inputs consistently outperform real satellite imagery on multiple downstream tasks, including yield and nitrogen prediction, demonstrating the potential of cross-modal correspondence learning to bridge the gap between satellite and UAV sensing in agricultural monitoring.
format Preprint
id arxiv_https___arxiv_org_abs_2511_16031
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Crossmodal learning for Crop Canopy Trait Estimation
Ayanlade, Timilehin T.
Powadi, Anirudha
Jubery, Talukder Z.
Ganapathysubramanian, Baskar
Sarkar, Soumik
Computer Vision and Pattern Recognition
Recent advances in plant phenotyping have driven widespread adoption of multi sensor platforms for collecting crop canopy reflectance data. This includes the collection of heterogeneous data across multiple platforms, with Unmanned Aerial Vehicles (UAV) seeing significant usage due to their high performance in crop monitoring, forecasting, and prediction tasks. Similarly, satellite missions have been shown to be effective for agriculturally relevant tasks. In contrast to UAVs, such missions are bound to the limitation of spatial resolution, which hinders their effectiveness for modern farming systems focused on micro-plot management. In this work, we propose a cross modal learning strategy that enriches high-resolution satellite imagery with UAV level visual detail for crop canopy trait estimation. Using a dataset of approximately co registered satellite UAV image pairs collected from replicated plots of 84 hybrid maize varieties across five distinct locations in the U.S. Corn Belt, we train a model that learns fine grained spectral spatial correspondences between sensing modalities. Results show that the generated UAV-like representations from satellite inputs consistently outperform real satellite imagery on multiple downstream tasks, including yield and nitrogen prediction, demonstrating the potential of cross-modal correspondence learning to bridge the gap between satellite and UAV sensing in agricultural monitoring.
title Crossmodal learning for Crop Canopy Trait Estimation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.16031