Assessing SAM for Tree Crown Instance Segmentation from Drone Imagery
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908284943859712 |
|---|---|
| author | Teng, Mélisande Ouaknine, Arthur Laliberté, Etienne Bengio, Yoshua Rolnick, David Larochelle, Hugo |
| author_facet | Teng, Mélisande Ouaknine, Arthur Laliberté, Etienne Bengio, Yoshua Rolnick, David Larochelle, Hugo |
| contents | The potential of tree planting as a natural climate solution is often undermined by inadequate monitoring of tree planting projects. Current monitoring methods involve measuring trees by hand for each species, requiring extensive cost, time, and labour. Advances in drone remote sensing and computer vision offer great potential for mapping and characterizing trees from aerial imagery, and large pre-trained vision models, such as the Segment Anything Model (SAM), may be a particularly compelling choice given limited labeled data. In this work, we compare SAM methods for the task of automatic tree crown instance segmentation in high resolution drone imagery of young tree plantations. We explore the potential of SAM for this task, and find that methods using SAM out-of-the-box do not outperform a custom Mask R-CNN, even with well-designed prompts, but that there is potential for methods which tune SAM further. We also show that predictions can be improved by adding Digital Surface Model (DSM) information as an input. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_20199 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Assessing SAM for Tree Crown Instance Segmentation from Drone Imagery Teng, Mélisande Ouaknine, Arthur Laliberté, Etienne Bengio, Yoshua Rolnick, David Larochelle, Hugo Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning The potential of tree planting as a natural climate solution is often undermined by inadequate monitoring of tree planting projects. Current monitoring methods involve measuring trees by hand for each species, requiring extensive cost, time, and labour. Advances in drone remote sensing and computer vision offer great potential for mapping and characterizing trees from aerial imagery, and large pre-trained vision models, such as the Segment Anything Model (SAM), may be a particularly compelling choice given limited labeled data. In this work, we compare SAM methods for the task of automatic tree crown instance segmentation in high resolution drone imagery of young tree plantations. We explore the potential of SAM for this task, and find that methods using SAM out-of-the-box do not outperform a custom Mask R-CNN, even with well-designed prompts, but that there is potential for methods which tune SAM further. We also show that predictions can be improved by adding Digital Surface Model (DSM) information as an input. |
| title | Assessing SAM for Tree Crown Instance Segmentation from Drone Imagery |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2503.20199 |