Hierarchical Graph Interaction Transformer with Dynamic Token Clustering for Camouflaged Object Detection

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Yao, Siyuan, Sun, Hao, Xiang, Tian-Zhu, Wang, Xiao, Cao, Xiaochun
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866929509452742656
author Yao, Siyuan
Sun, Hao
Xiang, Tian-Zhu
Wang, Xiao
Cao, Xiaochun
author_facet Yao, Siyuan
Sun, Hao
Xiang, Tian-Zhu
Wang, Xiao
Cao, Xiaochun
contents Camouflaged object detection (COD) aims to identify the objects that seamlessly blend into the surrounding backgrounds. Due to the intrinsic similarity between the camouflaged objects and the background region, it is extremely challenging to precisely distinguish the camouflaged objects by existing approaches. In this paper, we propose a hierarchical graph interaction network termed HGINet for camouflaged object detection, which is capable of discovering imperceptible objects via effective graph interaction among the hierarchical tokenized features. Specifically, we first design a region-aware token focusing attention (RTFA) with dynamic token clustering to excavate the potentially distinguishable tokens in the local region. Afterwards, a hierarchical graph interaction transformer (HGIT) is proposed to construct bi-directional aligned communication between hierarchical features in the latent interaction space for visual semantics enhancement. Furthermore, we propose a decoder network with confidence aggregated feature fusion (CAFF) modules, which progressively fuses the hierarchical interacted features to refine the local detail in ambiguous regions. Extensive experiments conducted on the prevalent datasets, i.e. COD10K, CAMO, NC4K and CHAMELEON demonstrate the superior performance of HGINet compared to existing state-of-the-art methods. Our code is available at https://github.com/Garyson1204/HGINet.
format Preprint
id arxiv_https___arxiv_org_abs_2408_15020
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Hierarchical Graph Interaction Transformer with Dynamic Token Clustering for Camouflaged Object Detection
Yao, Siyuan
Sun, Hao
Xiang, Tian-Zhu
Wang, Xiao
Cao, Xiaochun
Computer Vision and Pattern Recognition
Camouflaged object detection (COD) aims to identify the objects that seamlessly blend into the surrounding backgrounds. Due to the intrinsic similarity between the camouflaged objects and the background region, it is extremely challenging to precisely distinguish the camouflaged objects by existing approaches. In this paper, we propose a hierarchical graph interaction network termed HGINet for camouflaged object detection, which is capable of discovering imperceptible objects via effective graph interaction among the hierarchical tokenized features. Specifically, we first design a region-aware token focusing attention (RTFA) with dynamic token clustering to excavate the potentially distinguishable tokens in the local region. Afterwards, a hierarchical graph interaction transformer (HGIT) is proposed to construct bi-directional aligned communication between hierarchical features in the latent interaction space for visual semantics enhancement. Furthermore, we propose a decoder network with confidence aggregated feature fusion (CAFF) modules, which progressively fuses the hierarchical interacted features to refine the local detail in ambiguous regions. Extensive experiments conducted on the prevalent datasets, i.e. COD10K, CAMO, NC4K and CHAMELEON demonstrate the superior performance of HGINet compared to existing state-of-the-art methods. Our code is available at https://github.com/Garyson1204/HGINet.
title Hierarchical Graph Interaction Transformer with Dynamic Token Clustering for Camouflaged Object Detection
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2408.15020