PlantSAM: An Object Detection-Driven Segmentation Pipeline for Herbarium Specimens
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916856270422016 |
|---|---|
| author | Sklab, Youcef Castanet, Florian Ariouat, Hanane Arib, Souhila Zucker, Jean-Daniel Chenin, Eric Prifti, Edi |
| author_facet | Sklab, Youcef Castanet, Florian Ariouat, Hanane Arib, Souhila Zucker, Jean-Daniel Chenin, Eric Prifti, Edi |
| contents | Deep learning-based classification of herbarium images is hampered by background heterogeneity, which introduces noise and artifacts that can potentially mislead models and reduce classification accuracy. Addressing these background-related challenges is critical to improving model performance. We introduce PlantSAM, an automated segmentation pipeline that integrates YOLOv10 for plant region detection and the Segment Anything Model (SAM2) for segmentation. YOLOv10 generates bounding box prompts to guide SAM2, enhancing segmentation accuracy. Both models were fine-tuned on herbarium images and evaluated using Intersection over Union (IoU) and Dice coefficient metrics. PlantSAM achieved state-of-the-art segmentation performance, with an IoU of 0.94 and a Dice coefficient of 0.97. Incorporating segmented images into classification models led to consistent performance improvements across five tested botanical traits, with accuracy gains of up to 4.36% and F1-score improvements of 4.15%. Our findings highlight the importance of background removal in herbarium image analysis, as it significantly enhances classification accuracy by allowing models to focus more effectively on the foreground plant structures. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_16506 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | PlantSAM: An Object Detection-Driven Segmentation Pipeline for Herbarium Specimens Sklab, Youcef Castanet, Florian Ariouat, Hanane Arib, Souhila Zucker, Jean-Daniel Chenin, Eric Prifti, Edi Computer Vision and Pattern Recognition Deep learning-based classification of herbarium images is hampered by background heterogeneity, which introduces noise and artifacts that can potentially mislead models and reduce classification accuracy. Addressing these background-related challenges is critical to improving model performance. We introduce PlantSAM, an automated segmentation pipeline that integrates YOLOv10 for plant region detection and the Segment Anything Model (SAM2) for segmentation. YOLOv10 generates bounding box prompts to guide SAM2, enhancing segmentation accuracy. Both models were fine-tuned on herbarium images and evaluated using Intersection over Union (IoU) and Dice coefficient metrics. PlantSAM achieved state-of-the-art segmentation performance, with an IoU of 0.94 and a Dice coefficient of 0.97. Incorporating segmented images into classification models led to consistent performance improvements across five tested botanical traits, with accuracy gains of up to 4.36% and F1-score improvements of 4.15%. Our findings highlight the importance of background removal in herbarium image analysis, as it significantly enhances classification accuracy by allowing models to focus more effectively on the foreground plant structures. |
| title | PlantSAM: An Object Detection-Driven Segmentation Pipeline for Herbarium Specimens |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2507.16506 |