Toward Realistic Camouflaged Object Detection: Benchmarks and Method

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xin, Zhimeng, Wu, Tianxu, Chen, Shiming, Ye, Shuo, Xie, Zijing, Zou, Yixiong, You, Xinge, Guo, Yufei
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912186064961536
author Xin, Zhimeng
Wu, Tianxu
Chen, Shiming
Ye, Shuo
Xie, Zijing
Zou, Yixiong
You, Xinge
Guo, Yufei
author_facet Xin, Zhimeng
Wu, Tianxu
Chen, Shiming
Ye, Shuo
Xie, Zijing
Zou, Yixiong
You, Xinge
Guo, Yufei
contents Camouflaged object detection (COD) primarily relies on semantic or instance segmentation methods. While these methods have made significant advancements in identifying the contours of camouflaged objects, they may be inefficient or cost-effective for tasks that only require the specific location of the object. Object detection algorithms offer an optimized solution for Realistic Camouflaged Object Detection (RCOD) in such cases. However, detecting camouflaged objects remains a formidable challenge due to the high degree of similarity between the features of the objects and their backgrounds. Unlike segmentation methods that perform pixel-wise comparisons to differentiate between foreground and background, object detectors omit this analysis, further aggravating the challenge. To solve this problem, we propose a camouflage-aware feature refinement (CAFR) strategy. Since camouflaged objects are not rare categories, CAFR fully utilizes a clear perception of the current object within the prior knowledge of large models to assist detectors in deeply understanding the distinctions between background and foreground. Specifically, in CAFR, we introduce the Adaptive Gradient Propagation (AGP) module that fine-tunes all feature extractor layers in large detection models to fully refine class-specific features from camouflaged contexts. We then design the Sparse Feature Refinement (SFR) module that optimizes the transformer-based feature extractor to focus primarily on capturing class-specific features in camouflaged scenarios. To facilitate the assessment of RCOD tasks, we manually annotate the labels required for detection on three existing segmentation COD datasets, creating a new benchmark for RCOD tasks. Code and datasets are available at: https://github.com/zhimengXin/RCOD.
format Preprint
id arxiv_https___arxiv_org_abs_2501_07297
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Toward Realistic Camouflaged Object Detection: Benchmarks and Method
Xin, Zhimeng
Wu, Tianxu
Chen, Shiming
Ye, Shuo
Xie, Zijing
Zou, Yixiong
You, Xinge
Guo, Yufei
Computer Vision and Pattern Recognition
Camouflaged object detection (COD) primarily relies on semantic or instance segmentation methods. While these methods have made significant advancements in identifying the contours of camouflaged objects, they may be inefficient or cost-effective for tasks that only require the specific location of the object. Object detection algorithms offer an optimized solution for Realistic Camouflaged Object Detection (RCOD) in such cases. However, detecting camouflaged objects remains a formidable challenge due to the high degree of similarity between the features of the objects and their backgrounds. Unlike segmentation methods that perform pixel-wise comparisons to differentiate between foreground and background, object detectors omit this analysis, further aggravating the challenge. To solve this problem, we propose a camouflage-aware feature refinement (CAFR) strategy. Since camouflaged objects are not rare categories, CAFR fully utilizes a clear perception of the current object within the prior knowledge of large models to assist detectors in deeply understanding the distinctions between background and foreground. Specifically, in CAFR, we introduce the Adaptive Gradient Propagation (AGP) module that fine-tunes all feature extractor layers in large detection models to fully refine class-specific features from camouflaged contexts. We then design the Sparse Feature Refinement (SFR) module that optimizes the transformer-based feature extractor to focus primarily on capturing class-specific features in camouflaged scenarios. To facilitate the assessment of RCOD tasks, we manually annotate the labels required for detection on three existing segmentation COD datasets, creating a new benchmark for RCOD tasks. Code and datasets are available at: https://github.com/zhimengXin/RCOD.
title Toward Realistic Camouflaged Object Detection: Benchmarks and Method
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2501.07297