Learning from Unlabelled Data with Transformers: Domain Adaptation for Semantic Segmentation of High Resolution Aerial Images

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Dionelis, Nikolaos, Pro, Francesco, Maiano, Luca, Amerini, Irene, Saux, Bertrand Le
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911844003741696
author Dionelis, Nikolaos
Pro, Francesco
Maiano, Luca
Amerini, Irene
Saux, Bertrand Le
author_facet Dionelis, Nikolaos
Pro, Francesco
Maiano, Luca
Amerini, Irene
Saux, Bertrand Le
contents Data from satellites or aerial vehicles are most of the times unlabelled. Annotating such data accurately is difficult, requires expertise, and is costly in terms of time. Even if Earth Observation (EO) data were correctly labelled, labels might change over time. Learning from unlabelled data within a semi-supervised learning framework for segmentation of aerial images is challenging. In this paper, we develop a new model for semantic segmentation of unlabelled images, the Non-annotated Earth Observation Semantic Segmentation (NEOS) model. NEOS performs domain adaptation as the target domain does not have ground truth semantic segmentation masks. The distribution inconsistencies between the target and source domains are due to differences in acquisition scenes, environment conditions, sensors, and times. Our model aligns the learned representations of the different domains to make them coincide. The evaluation results show that NEOS is successful and outperforms other models for semantic segmentation of unlabelled data.
format Preprint
id arxiv_https___arxiv_org_abs_2404_11299
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Learning from Unlabelled Data with Transformers: Domain Adaptation for Semantic Segmentation of High Resolution Aerial Images
Dionelis, Nikolaos
Pro, Francesco
Maiano, Luca
Amerini, Irene
Saux, Bertrand Le
Computer Vision and Pattern Recognition
Machine Learning
Data from satellites or aerial vehicles are most of the times unlabelled. Annotating such data accurately is difficult, requires expertise, and is costly in terms of time. Even if Earth Observation (EO) data were correctly labelled, labels might change over time. Learning from unlabelled data within a semi-supervised learning framework for segmentation of aerial images is challenging. In this paper, we develop a new model for semantic segmentation of unlabelled images, the Non-annotated Earth Observation Semantic Segmentation (NEOS) model. NEOS performs domain adaptation as the target domain does not have ground truth semantic segmentation masks. The distribution inconsistencies between the target and source domains are due to differences in acquisition scenes, environment conditions, sensors, and times. Our model aligns the learned representations of the different domains to make them coincide. The evaluation results show that NEOS is successful and outperforms other models for semantic segmentation of unlabelled data.
title Learning from Unlabelled Data with Transformers: Domain Adaptation for Semantic Segmentation of High Resolution Aerial Images
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2404.11299