Multi-label Instance-level Generalised Visual Grounding in Agriculture

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Haghighat, Mohammadreza, Saleh, Alzayat, Azghadi, Mostafa Rahimi
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866918376251588608
author Haghighat, Mohammadreza
Saleh, Alzayat
Azghadi, Mostafa Rahimi
author_facet Haghighat, Mohammadreza
Saleh, Alzayat
Azghadi, Mostafa Rahimi
contents Understanding field imagery such as detecting plants and distinguishing individual crop and weed instances is a central challenge in precision agriculture. Despite progress in vision-language tasks like captioning and visual question answering, Visual Grounding (VG), localising language-referred objects, remains unexplored in agriculture. A key reason is the lack of suitable benchmark datasets for evaluating grounding models in field conditions, where many plants look highly similar, appear at multiple scales, and the referred target may be absent from the image. To address these limitations, we introduce gRef-CW, the first dataset designed for generalised visual grounding in agriculture, including negative expressions. Benchmarking current state-of-the-art grounding models on gRef-CW reveals a substantial domain gap, highlighting their inability to ground instances of crops and weeds. Motivated by these findings, we introduce Weed-VG, a modular framework that incorporates multi-label hierarchical relevance scoring and interpolation-driven regression. Weed-VG advances instance-level visual grounding and provides a clear baseline for developing VG methods in precision agriculture. Code will be released upon acceptance.
format Preprint
id arxiv_https___arxiv_org_abs_2603_06699
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Multi-label Instance-level Generalised Visual Grounding in Agriculture
Haghighat, Mohammadreza
Saleh, Alzayat
Azghadi, Mostafa Rahimi
Computer Vision and Pattern Recognition
Understanding field imagery such as detecting plants and distinguishing individual crop and weed instances is a central challenge in precision agriculture. Despite progress in vision-language tasks like captioning and visual question answering, Visual Grounding (VG), localising language-referred objects, remains unexplored in agriculture. A key reason is the lack of suitable benchmark datasets for evaluating grounding models in field conditions, where many plants look highly similar, appear at multiple scales, and the referred target may be absent from the image. To address these limitations, we introduce gRef-CW, the first dataset designed for generalised visual grounding in agriculture, including negative expressions. Benchmarking current state-of-the-art grounding models on gRef-CW reveals a substantial domain gap, highlighting their inability to ground instances of crops and weeds. Motivated by these findings, we introduce Weed-VG, a modular framework that incorporates multi-label hierarchical relevance scoring and interpolation-driven regression. Weed-VG advances instance-level visual grounding and provides a clear baseline for developing VG methods in precision agriculture. Code will be released upon acceptance.
title Multi-label Instance-level Generalised Visual Grounding in Agriculture
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.06699