Semantically Robust Unsupervised Image Translation for Paired Remote Sensing Images

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Fang, Sheng, Li, Kaiyu, Li, Zhe, Zhao, Jianli, Zhang, Xingli
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866929717941108736
author Fang, Sheng
Li, Kaiyu
Li, Zhe
Zhao, Jianli
Zhang, Xingli
author_facet Fang, Sheng
Li, Kaiyu
Li, Zhe
Zhao, Jianli
Zhang, Xingli
contents Image translation for change detection or classification in bi-temporal remote sensing images is unique. Although it can acquire paired images, it is still unsupervised. Moreover, strict semantic preservation in translation is always needed instead of multimodal outputs. In response to these problems, this paper proposes a new method, SRUIT (Semantically Robust Unsupervised Image-to-image Translation), which ensures semantically robust translation and produces deterministic output. Inspired by previous works, the method explores the underlying characteristics of bi-temporal Remote Sensing images and designs the corresponding networks. Firstly, we assume that bi-temporal Remote Sensing images share the same latent space, for they are always acquired from the same land location. So SRUIT makes the generators share their high-level layers, and this constraint will compel two domain mapping to fall into the same latent space. Secondly, considering land covers of bi-temporal images could evolve into each other, SRUIT exploits the cross-cycle-consistent adversarial networks to translate from one to the other and recover them. Experimental results show that constraints of sharing weights and cross-cycle consistency enable translated images with both good perceptual image quality and semantic preservation for significant differences.
format Preprint
id arxiv_https___arxiv_org_abs_2502_11468
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Semantically Robust Unsupervised Image Translation for Paired Remote Sensing Images
Fang, Sheng
Li, Kaiyu
Li, Zhe
Zhao, Jianli
Zhang, Xingli
Computer Vision and Pattern Recognition
Image translation for change detection or classification in bi-temporal remote sensing images is unique. Although it can acquire paired images, it is still unsupervised. Moreover, strict semantic preservation in translation is always needed instead of multimodal outputs. In response to these problems, this paper proposes a new method, SRUIT (Semantically Robust Unsupervised Image-to-image Translation), which ensures semantically robust translation and produces deterministic output. Inspired by previous works, the method explores the underlying characteristics of bi-temporal Remote Sensing images and designs the corresponding networks. Firstly, we assume that bi-temporal Remote Sensing images share the same latent space, for they are always acquired from the same land location. So SRUIT makes the generators share their high-level layers, and this constraint will compel two domain mapping to fall into the same latent space. Secondly, considering land covers of bi-temporal images could evolve into each other, SRUIT exploits the cross-cycle-consistent adversarial networks to translate from one to the other and recover them. Experimental results show that constraints of sharing weights and cross-cycle consistency enable translated images with both good perceptual image quality and semantic preservation for significant differences.
title Semantically Robust Unsupervised Image Translation for Paired Remote Sensing Images
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2502.11468