DeepAndes: A Self-Supervised Vision Foundation Model for Multi-Spectral Remote Sensing Imagery of the Andes
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915605297233920 |
|---|---|
| author | Guo, Junlin Zimmer-Dauphinee, James R. Nieusma, Jordan M. Lu, Siqi Liu, Quan Deng, Ruining Cui, Can Yue, Jialin Lin, Yizhe Yao, Tianyuan Xiong, Juming Zhu, Junchao Qu, Chongyu Yang, Yuechen Wilkes, Mitchell Wang, Xiao VanValkenburgh, Parker Wernke, Steven A. Huo, Yuankai |
| author_facet | Guo, Junlin Zimmer-Dauphinee, James R. Nieusma, Jordan M. Lu, Siqi Liu, Quan Deng, Ruining Cui, Can Yue, Jialin Lin, Yizhe Yao, Tianyuan Xiong, Juming Zhu, Junchao Qu, Chongyu Yang, Yuechen Wilkes, Mitchell Wang, Xiao VanValkenburgh, Parker Wernke, Steven A. Huo, Yuankai |
| contents | By mapping sites at large scales using remotely sensed data, archaeologists can generate unique insights into long-term demographic trends, inter-regional social networks, and past adaptations to climate change. Remote sensing surveys complement field-based approaches, and their reach can be especially great when combined with deep learning and computer vision techniques. However, conventional supervised deep learning methods face challenges in annotating fine-grained archaeological features at scale. While recent vision foundation models have shown remarkable success in learning large-scale remote sensing data with minimal annotations, most off-the-shelf solutions are designed for RGB images rather than multi-spectral satellite imagery, such as the 8-band data used in our study. In this paper, we introduce DeepAndes, a transformer-based vision foundation model trained on three million multi-spectral satellite images, specifically tailored for Andean archaeology. DeepAndes incorporates a customized DINOv2 self-supervised learning algorithm optimized for 8-band multi-spectral imagery, marking the first foundation model designed explicitly for the Andes region. We evaluate its image understanding performance through imbalanced image classification, image instance retrieval, and pixel-level semantic segmentation tasks. Our experiments show that DeepAndes achieves superior F1 scores, mean average precision, and Dice scores in few-shot learning scenarios, significantly outperforming models trained from scratch or pre-trained on smaller datasets. This underscores the effectiveness of large-scale self-supervised pre-training in archaeological remote sensing. Codes will be available on https://github.com/geopacha/DeepAndes. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_20303 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | DeepAndes: A Self-Supervised Vision Foundation Model for Multi-Spectral Remote Sensing Imagery of the Andes Guo, Junlin Zimmer-Dauphinee, James R. Nieusma, Jordan M. Lu, Siqi Liu, Quan Deng, Ruining Cui, Can Yue, Jialin Lin, Yizhe Yao, Tianyuan Xiong, Juming Zhu, Junchao Qu, Chongyu Yang, Yuechen Wilkes, Mitchell Wang, Xiao VanValkenburgh, Parker Wernke, Steven A. Huo, Yuankai Computer Vision and Pattern Recognition By mapping sites at large scales using remotely sensed data, archaeologists can generate unique insights into long-term demographic trends, inter-regional social networks, and past adaptations to climate change. Remote sensing surveys complement field-based approaches, and their reach can be especially great when combined with deep learning and computer vision techniques. However, conventional supervised deep learning methods face challenges in annotating fine-grained archaeological features at scale. While recent vision foundation models have shown remarkable success in learning large-scale remote sensing data with minimal annotations, most off-the-shelf solutions are designed for RGB images rather than multi-spectral satellite imagery, such as the 8-band data used in our study. In this paper, we introduce DeepAndes, a transformer-based vision foundation model trained on three million multi-spectral satellite images, specifically tailored for Andean archaeology. DeepAndes incorporates a customized DINOv2 self-supervised learning algorithm optimized for 8-band multi-spectral imagery, marking the first foundation model designed explicitly for the Andes region. We evaluate its image understanding performance through imbalanced image classification, image instance retrieval, and pixel-level semantic segmentation tasks. Our experiments show that DeepAndes achieves superior F1 scores, mean average precision, and Dice scores in few-shot learning scenarios, significantly outperforming models trained from scratch or pre-trained on smaller datasets. This underscores the effectiveness of large-scale self-supervised pre-training in archaeological remote sensing. Codes will be available on https://github.com/geopacha/DeepAndes. |
| title | DeepAndes: A Self-Supervised Vision Foundation Model for Multi-Spectral Remote Sensing Imagery of the Andes |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2504.20303 |