Multi-Label Plant Species Prediction with Metadata-Enhanced Multi-Head Vision Transformers

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Herasimchyk, Hanna, Labryga, Robin, Prusina, Tomislav
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915446513467392
author Herasimchyk, Hanna
Labryga, Robin
Prusina, Tomislav
author_facet Herasimchyk, Hanna
Labryga, Robin
Prusina, Tomislav
contents We present a multi-head vision transformer approach for multi-label plant species prediction in vegetation plot images, addressing the PlantCLEF 2025 challenge. The task involves training models on single-species plant images while testing on multi-species quadrat images, creating a drastic domain shift. Our methodology leverages a pre-trained DINOv2 Vision Transformer Base (ViT-B/14) backbone with multiple classification heads for species, genus, and family prediction, utilizing taxonomic hierarchies. Key contributions include multi-scale tiling to capture plants at different scales, dynamic threshold optimization based on mean prediction length, and ensemble strategies through bagging and Hydra model architectures. The approach incorporates various inference techniques including image cropping to remove non-plant artifacts, top-n filtering for prediction constraints, and logit thresholding strategies. Experiments were conducted on approximately 1.4 million training images covering 7,806 plant species. Results demonstrate strong performance, making our submission 3rd best on the private leaderboard. Our code is available at https://github.com/geranium12/plant-clef-2025/tree/v1.0.0.
format Preprint
id arxiv_https___arxiv_org_abs_2508_10457
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Multi-Label Plant Species Prediction with Metadata-Enhanced Multi-Head Vision Transformers
Herasimchyk, Hanna
Labryga, Robin
Prusina, Tomislav
Computer Vision and Pattern Recognition
Information Retrieval
Machine Learning
We present a multi-head vision transformer approach for multi-label plant species prediction in vegetation plot images, addressing the PlantCLEF 2025 challenge. The task involves training models on single-species plant images while testing on multi-species quadrat images, creating a drastic domain shift. Our methodology leverages a pre-trained DINOv2 Vision Transformer Base (ViT-B/14) backbone with multiple classification heads for species, genus, and family prediction, utilizing taxonomic hierarchies. Key contributions include multi-scale tiling to capture plants at different scales, dynamic threshold optimization based on mean prediction length, and ensemble strategies through bagging and Hydra model architectures. The approach incorporates various inference techniques including image cropping to remove non-plant artifacts, top-n filtering for prediction constraints, and logit thresholding strategies. Experiments were conducted on approximately 1.4 million training images covering 7,806 plant species. Results demonstrate strong performance, making our submission 3rd best on the private leaderboard. Our code is available at https://github.com/geranium12/plant-clef-2025/tree/v1.0.0.
title Multi-Label Plant Species Prediction with Metadata-Enhanced Multi-Head Vision Transformers
topic Computer Vision and Pattern Recognition
Information Retrieval
Machine Learning
url https://arxiv.org/abs/2508.10457