Global-Local Detail Guided Transformer for Sea Ice Recognition in Optical Remote Sensing Images

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Huang, Zhanchao, Hong, Wenjun, Su, Hua
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911883770986496
author Huang, Zhanchao
Hong, Wenjun
Su, Hua
author_facet Huang, Zhanchao
Hong, Wenjun
Su, Hua
contents The recognition of sea ice is of great significance for reflecting climate change and ensuring the safety of ship navigation. Recently, many deep learning based methods have been proposed and applied to segment and recognize sea ice regions. However, the diverse scales of sea ice areas, the zigzag and fine edge contours, and the difficulty in distinguishing different types of sea ice pose challenges to existing sea ice recognition models. In this paper, a Global-Local Detail Guided Transformer (GDGT) method is proposed for sea ice recognition in optical remote sensing images. In GDGT, a global-local feature fusiont mechanism is designed to fuse global structural correlation features and local spatial detail features. Furthermore, a detail-guided decoder is developed to retain more high-resolution detail information during feature reconstruction for improving the performance of sea ice recognition. Experiments on the produced sea ice dataset demonstrated the effectiveness and advancement of GDGT.
format Preprint
id arxiv_https___arxiv_org_abs_2405_13197
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Global-Local Detail Guided Transformer for Sea Ice Recognition in Optical Remote Sensing Images
Huang, Zhanchao
Hong, Wenjun
Su, Hua
Computer Vision and Pattern Recognition
The recognition of sea ice is of great significance for reflecting climate change and ensuring the safety of ship navigation. Recently, many deep learning based methods have been proposed and applied to segment and recognize sea ice regions. However, the diverse scales of sea ice areas, the zigzag and fine edge contours, and the difficulty in distinguishing different types of sea ice pose challenges to existing sea ice recognition models. In this paper, a Global-Local Detail Guided Transformer (GDGT) method is proposed for sea ice recognition in optical remote sensing images. In GDGT, a global-local feature fusiont mechanism is designed to fuse global structural correlation features and local spatial detail features. Furthermore, a detail-guided decoder is developed to retain more high-resolution detail information during feature reconstruction for improving the performance of sea ice recognition. Experiments on the produced sea ice dataset demonstrated the effectiveness and advancement of GDGT.
title Global-Local Detail Guided Transformer for Sea Ice Recognition in Optical Remote Sensing Images
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2405.13197