WeedSense: Multi-Task Learning for Weed Segmentation, Height Estimation, and Growth Stage Classification

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Sarker, Toqi Tahamid, Ahmed, Khaled R, Islam, Taminul, Rankrape, Cristiana Bernardi, Gage, Karla
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909745377443840
author Sarker, Toqi Tahamid
Ahmed, Khaled R
Islam, Taminul
Rankrape, Cristiana Bernardi
Gage, Karla
author_facet Sarker, Toqi Tahamid
Ahmed, Khaled R
Islam, Taminul
Rankrape, Cristiana Bernardi
Gage, Karla
contents Weed management represents a critical challenge in agriculture, significantly impacting crop yields and requiring substantial resources for control. Effective weed monitoring and analysis strategies are crucial for implementing sustainable agricultural practices and site-specific management approaches. We introduce WeedSense, a novel multi-task learning architecture for comprehensive weed analysis that jointly performs semantic segmentation, height estimation, and growth stage classification. We present a unique dataset capturing 16 weed species over an 11-week growth cycle with pixel-level annotations, height measurements, and temporal labels. WeedSense leverages a dual-path encoder incorporating Universal Inverted Bottleneck blocks and a Multi-Task Bifurcated Decoder with transformer-based feature fusion to generate multi-scale features and enable simultaneous prediction across multiple tasks. WeedSense outperforms other state-of-the-art models on our comprehensive evaluation. On our multi-task dataset, WeedSense achieves mIoU of 89.78% for segmentation, 1.67cm MAE for height estimation, and 99.99% accuracy for growth stage classification while maintaining real-time inference at 160 FPS. Our multitask approach achieves 3$\times$ faster inference than sequential single-task execution and uses 32.4% fewer parameters. Please see our project page at weedsense.github.io.
format Preprint
id arxiv_https___arxiv_org_abs_2508_14486
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle WeedSense: Multi-Task Learning for Weed Segmentation, Height Estimation, and Growth Stage Classification
Sarker, Toqi Tahamid
Ahmed, Khaled R
Islam, Taminul
Rankrape, Cristiana Bernardi
Gage, Karla
Computer Vision and Pattern Recognition
Weed management represents a critical challenge in agriculture, significantly impacting crop yields and requiring substantial resources for control. Effective weed monitoring and analysis strategies are crucial for implementing sustainable agricultural practices and site-specific management approaches. We introduce WeedSense, a novel multi-task learning architecture for comprehensive weed analysis that jointly performs semantic segmentation, height estimation, and growth stage classification. We present a unique dataset capturing 16 weed species over an 11-week growth cycle with pixel-level annotations, height measurements, and temporal labels. WeedSense leverages a dual-path encoder incorporating Universal Inverted Bottleneck blocks and a Multi-Task Bifurcated Decoder with transformer-based feature fusion to generate multi-scale features and enable simultaneous prediction across multiple tasks. WeedSense outperforms other state-of-the-art models on our comprehensive evaluation. On our multi-task dataset, WeedSense achieves mIoU of 89.78% for segmentation, 1.67cm MAE for height estimation, and 99.99% accuracy for growth stage classification while maintaining real-time inference at 160 FPS. Our multitask approach achieves 3$\times$ faster inference than sequential single-task execution and uses 32.4% fewer parameters. Please see our project page at weedsense.github.io.
title WeedSense: Multi-Task Learning for Weed Segmentation, Height Estimation, and Growth Stage Classification
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2508.14486