AgriGPT-VL: Agricultural Vision-Language Understanding Suite

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Yang, Bo, Chen, Yunkui, Feng, Lanfei, Zhang, Yu, Xu, Xiao, Zhang, Jianyu, Aierken, Nueraili, Huang, Runhe, Lin, Hongjian, Ying, Yibin, Li, Shijian
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866918235375403008
author Yang, Bo
Chen, Yunkui
Feng, Lanfei
Zhang, Yu
Xu, Xiao
Zhang, Jianyu
Aierken, Nueraili
Huang, Runhe
Lin, Hongjian
Ying, Yibin
Li, Shijian
author_facet Yang, Bo
Chen, Yunkui
Feng, Lanfei
Zhang, Yu
Xu, Xiao
Zhang, Jianyu
Aierken, Nueraili
Huang, Runhe
Lin, Hongjian
Ying, Yibin
Li, Shijian
contents Despite rapid advances in multimodal large language models, agricultural applications remain constrained by the scarcity of domain-tailored models, curated vision-language corpora, and rigorous evaluation. To address these challenges, we present the AgriGPT-VL Suite, a unified multimodal framework for agriculture. Our contributions are threefold. First, we introduce Agri-3M-VL, the largest vision-language corpus for agriculture to our knowledge, curated by a scalable multi-agent data generator; it comprises 1M image-caption pairs, 2M image-grounded VQA pairs, 50K expert-level VQA instances, and 15K GRPO reinforcement learning samples. Second, we develop AgriGPT-VL, an agriculture-specialized vision-language model trained via a progressive curriculum of textual grounding, multimodal shallow/deep alignment, and GRPO refinement. This method achieves strong multimodal reasoning while preserving text-only capability. Third, we establish AgriBench-VL-4K, a compact yet challenging evaluation suite with open-ended and image-grounded questions, paired with multi-metric evaluation and an LLM-as-a-judge framework. Experiments show that AgriGPT-VL outperforms leading general-purpose VLMs on AgriBench-VL-4K, achieving higher pairwise win rates in the LLM-as-a-judge evaluation. Meanwhile, it remains competitive on the text-only AgriBench-13K with no noticeable degradation of language ability. Ablation studies further confirm consistent gains from our alignment and GRPO refinement stages. We will open source all of the resources to support reproducible research and deployment in low-resource agricultural settings.
format Preprint
id arxiv_https___arxiv_org_abs_2510_04002
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle AgriGPT-VL: Agricultural Vision-Language Understanding Suite
Yang, Bo
Chen, Yunkui
Feng, Lanfei
Zhang, Yu
Xu, Xiao
Zhang, Jianyu
Aierken, Nueraili
Huang, Runhe
Lin, Hongjian
Ying, Yibin
Li, Shijian
Computation and Language
Despite rapid advances in multimodal large language models, agricultural applications remain constrained by the scarcity of domain-tailored models, curated vision-language corpora, and rigorous evaluation. To address these challenges, we present the AgriGPT-VL Suite, a unified multimodal framework for agriculture. Our contributions are threefold. First, we introduce Agri-3M-VL, the largest vision-language corpus for agriculture to our knowledge, curated by a scalable multi-agent data generator; it comprises 1M image-caption pairs, 2M image-grounded VQA pairs, 50K expert-level VQA instances, and 15K GRPO reinforcement learning samples. Second, we develop AgriGPT-VL, an agriculture-specialized vision-language model trained via a progressive curriculum of textual grounding, multimodal shallow/deep alignment, and GRPO refinement. This method achieves strong multimodal reasoning while preserving text-only capability. Third, we establish AgriBench-VL-4K, a compact yet challenging evaluation suite with open-ended and image-grounded questions, paired with multi-metric evaluation and an LLM-as-a-judge framework. Experiments show that AgriGPT-VL outperforms leading general-purpose VLMs on AgriBench-VL-4K, achieving higher pairwise win rates in the LLM-as-a-judge evaluation. Meanwhile, it remains competitive on the text-only AgriBench-13K with no noticeable degradation of language ability. Ablation studies further confirm consistent gains from our alignment and GRPO refinement stages. We will open source all of the resources to support reproducible research and deployment in low-resource agricultural settings.
title AgriGPT-VL: Agricultural Vision-Language Understanding Suite
topic Computation and Language
url https://arxiv.org/abs/2510.04002