Deformable Attention Mechanisms Applied to Object Detection, case of Remote Sensing

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Boutayeb, Anasse, Lahsen-cherif, Iyad, Khadimi, Ahmed El
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912404169818112
author Boutayeb, Anasse
Lahsen-cherif, Iyad
Khadimi, Ahmed El
author_facet Boutayeb, Anasse
Lahsen-cherif, Iyad
Khadimi, Ahmed El
contents Object detection has recently seen an interesting trend in terms of the most innovative research work, this task being of particular importance in the field of remote sensing, given the consistency of these images in terms of geographical coverage and the objects present. Furthermore, Deep Learning (DL) models, in particular those based on Transformers, are especially relevant for visual computing tasks in general, and target detection in particular. Thus, the present work proposes an application of Deformable-DETR model, a specific architecture using deformable attention mechanisms, on remote sensing images in two different modes, especially optical and Synthetic Aperture Radar (SAR). To achieve this objective, two datasets are used, one optical, which is Pleiades Aircraft dataset, and the other SAR, in particular SAR Ship Detection Dataset (SSDD). The results of a 10-fold stratified validation showed that the proposed model performed particularly well, obtaining an F1 score of 95.12% for the optical dataset and 94.54% for SSDD, while comparing these results with several models detections, especially those based on CNNs and transformers, as well as those specifically designed to detect different object classes in remote sensing images.
format Preprint
id arxiv_https___arxiv_org_abs_2505_24489
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Deformable Attention Mechanisms Applied to Object Detection, case of Remote Sensing
Boutayeb, Anasse
Lahsen-cherif, Iyad
Khadimi, Ahmed El
Computer Vision and Pattern Recognition
Artificial Intelligence
Object detection has recently seen an interesting trend in terms of the most innovative research work, this task being of particular importance in the field of remote sensing, given the consistency of these images in terms of geographical coverage and the objects present. Furthermore, Deep Learning (DL) models, in particular those based on Transformers, are especially relevant for visual computing tasks in general, and target detection in particular. Thus, the present work proposes an application of Deformable-DETR model, a specific architecture using deformable attention mechanisms, on remote sensing images in two different modes, especially optical and Synthetic Aperture Radar (SAR). To achieve this objective, two datasets are used, one optical, which is Pleiades Aircraft dataset, and the other SAR, in particular SAR Ship Detection Dataset (SSDD). The results of a 10-fold stratified validation showed that the proposed model performed particularly well, obtaining an F1 score of 95.12% for the optical dataset and 94.54% for SSDD, while comparing these results with several models detections, especially those based on CNNs and transformers, as well as those specifically designed to detect different object classes in remote sensing images.
title Deformable Attention Mechanisms Applied to Object Detection, case of Remote Sensing
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2505.24489