Scoring, Remember, and Reference: Catching Camouflaged Objects in Videos

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Feng, Yuang, Gao, Shuyong, Yan, Fuzhen, Song, Yicheng, Hong, Lingyi, Hu, Junjie, Zhang, Wenqiang
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916659050053632
author Feng, Yuang
Gao, Shuyong
Yan, Fuzhen
Song, Yicheng
Hong, Lingyi
Hu, Junjie
Zhang, Wenqiang
author_facet Feng, Yuang
Gao, Shuyong
Yan, Fuzhen
Song, Yicheng
Hong, Lingyi
Hu, Junjie
Zhang, Wenqiang
contents Video Camouflaged Object Detection (VCOD) aims to segment objects whose appearances closely resemble their surroundings, posing a challenging and emerging task. Existing vision models often struggle in such scenarios due to the indistinguishable appearance of camouflaged objects and the insufficient exploitation of dynamic information in videos. To address these challenges, we propose an end-to-end VCOD framework inspired by human memory-recognition, which leverages historical video information by integrating memory reference frames for camouflaged sequence processing. Specifically, we design a dual-purpose decoder that simultaneously generates predicted masks and scores, enabling reference frame selection based on scores while introducing auxiliary supervision to enhance feature extraction.Furthermore, this study introduces a novel reference-guided multilevel asymmetric attention mechanism, effectively integrating long-term reference information with short-term motion cues for comprehensive feature extraction. By combining these modules, we develop the Scoring, Remember, and Reference (SRR) framework, which efficiently extracts information to locate targets and employs memory guidance to improve subsequent processing. With its optimized module design and effective utilization of video data, our model achieves significant performance improvements, surpassing existing approaches by 10% on benchmark datasets while requiring fewer parameters (54M) and only a single pass through the video. The code will be made publicly available.
format Preprint
id arxiv_https___arxiv_org_abs_2503_17050
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Scoring, Remember, and Reference: Catching Camouflaged Objects in Videos
Feng, Yuang
Gao, Shuyong
Yan, Fuzhen
Song, Yicheng
Hong, Lingyi
Hu, Junjie
Zhang, Wenqiang
Computer Vision and Pattern Recognition
Video Camouflaged Object Detection (VCOD) aims to segment objects whose appearances closely resemble their surroundings, posing a challenging and emerging task. Existing vision models often struggle in such scenarios due to the indistinguishable appearance of camouflaged objects and the insufficient exploitation of dynamic information in videos. To address these challenges, we propose an end-to-end VCOD framework inspired by human memory-recognition, which leverages historical video information by integrating memory reference frames for camouflaged sequence processing. Specifically, we design a dual-purpose decoder that simultaneously generates predicted masks and scores, enabling reference frame selection based on scores while introducing auxiliary supervision to enhance feature extraction.Furthermore, this study introduces a novel reference-guided multilevel asymmetric attention mechanism, effectively integrating long-term reference information with short-term motion cues for comprehensive feature extraction. By combining these modules, we develop the Scoring, Remember, and Reference (SRR) framework, which efficiently extracts information to locate targets and employs memory guidance to improve subsequent processing. With its optimized module design and effective utilization of video data, our model achieves significant performance improvements, surpassing existing approaches by 10% on benchmark datasets while requiring fewer parameters (54M) and only a single pass through the video. The code will be made publicly available.
title Scoring, Remember, and Reference: Catching Camouflaged Objects in Videos
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.17050