Weakly-supervised Contrastive Learning with Quantity Prompts for Moving Infrared Small Target Detection

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Duan, Weiwei, Ji, Luping, Chen, Shengjia, Zhu, Sicheng, Huang, Jianghong, Ye, Mao
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908801381171200
author Duan, Weiwei
Ji, Luping
Chen, Shengjia
Zhu, Sicheng
Huang, Jianghong
Ye, Mao
author_facet Duan, Weiwei
Ji, Luping
Chen, Shengjia
Zhu, Sicheng
Huang, Jianghong
Ye, Mao
contents Different from general object detection, moving infrared small target detection faces huge challenges due to tiny target size and weak background contrast.Currently, most existing methods are fully-supervised, heavily relying on a large number of manual target-wise annotations. However, manually annotating video sequences is often expensive and time-consuming, especially for low-quality infrared frame images. Inspired by general object detection, non-fully supervised strategies ($e.g.$, weakly supervised) are believed to be potential in reducing annotation requirements. To break through traditional fully-supervised frameworks, as the first exploration work, this paper proposes a new weakly-supervised contrastive learning (WeCoL) scheme, only requires simple target quantity prompts during model training.Specifically, in our scheme, based on the pretrained segment anything model (SAM), a potential target mining strategy is designed to integrate target activation maps and multi-frame energy accumulation.Besides, contrastive learning is adopted to further improve the reliability of pseudo-labels, by calculating the similarity between positive and negative samples in feature subspace.Moreover, we propose a long-short term motion-aware learning scheme to simultaneously model the local motion patterns and global motion trajectory of small targets.The extensive experiments on two public datasets (DAUB and ITSDT-15K) verify that our weakly-supervised scheme could often outperform early fully-supervised methods. Even, its performance could reach over 90\% of state-of-the-art (SOTA) fully-supervised ones.
format Preprint
id arxiv_https___arxiv_org_abs_2507_02454
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Weakly-supervised Contrastive Learning with Quantity Prompts for Moving Infrared Small Target Detection
Duan, Weiwei
Ji, Luping
Chen, Shengjia
Zhu, Sicheng
Huang, Jianghong
Ye, Mao
Computer Vision and Pattern Recognition
Different from general object detection, moving infrared small target detection faces huge challenges due to tiny target size and weak background contrast.Currently, most existing methods are fully-supervised, heavily relying on a large number of manual target-wise annotations. However, manually annotating video sequences is often expensive and time-consuming, especially for low-quality infrared frame images. Inspired by general object detection, non-fully supervised strategies ($e.g.$, weakly supervised) are believed to be potential in reducing annotation requirements. To break through traditional fully-supervised frameworks, as the first exploration work, this paper proposes a new weakly-supervised contrastive learning (WeCoL) scheme, only requires simple target quantity prompts during model training.Specifically, in our scheme, based on the pretrained segment anything model (SAM), a potential target mining strategy is designed to integrate target activation maps and multi-frame energy accumulation.Besides, contrastive learning is adopted to further improve the reliability of pseudo-labels, by calculating the similarity between positive and negative samples in feature subspace.Moreover, we propose a long-short term motion-aware learning scheme to simultaneously model the local motion patterns and global motion trajectory of small targets.The extensive experiments on two public datasets (DAUB and ITSDT-15K) verify that our weakly-supervised scheme could often outperform early fully-supervised methods. Even, its performance could reach over 90\% of state-of-the-art (SOTA) fully-supervised ones.
title Weakly-supervised Contrastive Learning with Quantity Prompts for Moving Infrared Small Target Detection
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.02454