Deep Clustering of Remote Sensing Scenes through Heterogeneous Transfer Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ray, Isaac, Skurikhin, Alexei
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912017223254016
author Ray, Isaac
Skurikhin, Alexei
author_facet Ray, Isaac
Skurikhin, Alexei
contents This paper proposes a method for unsupervised whole-image clustering of a target dataset of remote sensing scenes with no labels. The method consists of three main steps: (1) finetuning a pretrained deep neural network (DINOv2) on a labelled source remote sensing imagery dataset and using it to extract a feature vector from each image in the target dataset, (2) reducing the dimension of these deep features via manifold projection into a low-dimensional Euclidean space, and (3) clustering the embedded features using a Bayesian nonparametric technique to infer the number and membership of clusters simultaneously. The method takes advantage of heterogeneous transfer learning to cluster unseen data with different feature and label distributions. We demonstrate the performance of this approach outperforming state-of-the-art zero-shot classification methods on several remote sensing scene classification datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2409_03938
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Deep Clustering of Remote Sensing Scenes through Heterogeneous Transfer Learning
Ray, Isaac
Skurikhin, Alexei
Computer Vision and Pattern Recognition
Applications
This paper proposes a method for unsupervised whole-image clustering of a target dataset of remote sensing scenes with no labels. The method consists of three main steps: (1) finetuning a pretrained deep neural network (DINOv2) on a labelled source remote sensing imagery dataset and using it to extract a feature vector from each image in the target dataset, (2) reducing the dimension of these deep features via manifold projection into a low-dimensional Euclidean space, and (3) clustering the embedded features using a Bayesian nonparametric technique to infer the number and membership of clusters simultaneously. The method takes advantage of heterogeneous transfer learning to cluster unseen data with different feature and label distributions. We demonstrate the performance of this approach outperforming state-of-the-art zero-shot classification methods on several remote sensing scene classification datasets.
title Deep Clustering of Remote Sensing Scenes through Heterogeneous Transfer Learning
topic Computer Vision and Pattern Recognition
Applications
url https://arxiv.org/abs/2409.03938