Fields of The World: A Machine Learning Benchmark Dataset For Global Agricultural Field Boundary Segmentation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kerner, Hannah, Chaudhari, Snehal, Ghosh, Aninda, Robinson, Caleb, Ahmad, Adeel, Choi, Eddie, Jacobs, Nathan, Holmes, Chris, Mohr, Matthias, Dodhia, Rahul, Ferres, Juan M. Lavista, Marcus, Jennifer
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909435612364800
author Kerner, Hannah
Chaudhari, Snehal
Ghosh, Aninda
Robinson, Caleb
Ahmad, Adeel
Choi, Eddie
Jacobs, Nathan
Holmes, Chris
Mohr, Matthias
Dodhia, Rahul
Ferres, Juan M. Lavista
Marcus, Jennifer
author_facet Kerner, Hannah
Chaudhari, Snehal
Ghosh, Aninda
Robinson, Caleb
Ahmad, Adeel
Choi, Eddie
Jacobs, Nathan
Holmes, Chris
Mohr, Matthias
Dodhia, Rahul
Ferres, Juan M. Lavista
Marcus, Jennifer
contents Crop field boundaries are foundational datasets for agricultural monitoring and assessments but are expensive to collect manually. Machine learning (ML) methods for automatically extracting field boundaries from remotely sensed images could help realize the demand for these datasets at a global scale. However, current ML methods for field instance segmentation lack sufficient geographic coverage, accuracy, and generalization capabilities. Further, research on improving ML methods is restricted by the lack of labeled datasets representing the diversity of global agricultural fields. We present Fields of The World (FTW) -- a novel ML benchmark dataset for agricultural field instance segmentation spanning 24 countries on four continents (Europe, Africa, Asia, and South America). FTW is an order of magnitude larger than previous datasets with 70,462 samples, each containing instance and semantic segmentation masks paired with multi-date, multi-spectral Sentinel-2 satellite images. We provide results from baseline models for the new FTW benchmark, show that models trained on FTW have better zero-shot and fine-tuning performance in held-out countries than models that aren't pre-trained with diverse datasets, and show positive qualitative zero-shot results of FTW models in a real-world scenario -- running on Sentinel-2 scenes over Ethiopia.
format Preprint
id arxiv_https___arxiv_org_abs_2409_16252
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Fields of The World: A Machine Learning Benchmark Dataset For Global Agricultural Field Boundary Segmentation
Kerner, Hannah
Chaudhari, Snehal
Ghosh, Aninda
Robinson, Caleb
Ahmad, Adeel
Choi, Eddie
Jacobs, Nathan
Holmes, Chris
Mohr, Matthias
Dodhia, Rahul
Ferres, Juan M. Lavista
Marcus, Jennifer
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Crop field boundaries are foundational datasets for agricultural monitoring and assessments but are expensive to collect manually. Machine learning (ML) methods for automatically extracting field boundaries from remotely sensed images could help realize the demand for these datasets at a global scale. However, current ML methods for field instance segmentation lack sufficient geographic coverage, accuracy, and generalization capabilities. Further, research on improving ML methods is restricted by the lack of labeled datasets representing the diversity of global agricultural fields. We present Fields of The World (FTW) -- a novel ML benchmark dataset for agricultural field instance segmentation spanning 24 countries on four continents (Europe, Africa, Asia, and South America). FTW is an order of magnitude larger than previous datasets with 70,462 samples, each containing instance and semantic segmentation masks paired with multi-date, multi-spectral Sentinel-2 satellite images. We provide results from baseline models for the new FTW benchmark, show that models trained on FTW have better zero-shot and fine-tuning performance in held-out countries than models that aren't pre-trained with diverse datasets, and show positive qualitative zero-shot results of FTW models in a real-world scenario -- running on Sentinel-2 scenes over Ethiopia.
title Fields of The World: A Machine Learning Benchmark Dataset For Global Agricultural Field Boundary Segmentation
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2409.16252