RUN: Reversible Unfolding Network for Concealed Object Segmentation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: He, Chunming, Zhang, Rihan, Xiao, Fengyang, Fang, Chengyu, Tang, Longxiang, Zhang, Yulun, Kong, Linghe, Fan, Deng-Ping, Li, Kai, Farsiu, Sina
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915164134047744
author He, Chunming
Zhang, Rihan
Xiao, Fengyang
Fang, Chengyu
Tang, Longxiang
Zhang, Yulun
Kong, Linghe
Fan, Deng-Ping
Li, Kai
Farsiu, Sina
author_facet He, Chunming
Zhang, Rihan
Xiao, Fengyang
Fang, Chengyu
Tang, Longxiang
Zhang, Yulun
Kong, Linghe
Fan, Deng-Ping
Li, Kai
Farsiu, Sina
contents Existing concealed object segmentation (COS) methods frequently utilize reversible strategies to address uncertain regions. However, these approaches are typically restricted to the mask domain, leaving the potential of the RGB domain underexplored. To address this, we propose the Reversible Unfolding Network (RUN), which applies reversible strategies across both mask and RGB domains through a theoretically grounded framework, enabling accurate segmentation. RUN first formulates a novel COS model by incorporating an extra residual sparsity constraint to minimize segmentation uncertainties. The iterative optimization steps of the proposed model are then unfolded into a multistage network, with each step corresponding to a stage. Each stage of RUN consists of two reversible modules: the Segmentation-Oriented Foreground Separation (SOFS) module and the Reconstruction-Oriented Background Extraction (ROBE) module. SOFS applies the reversible strategy at the mask level and introduces Reversible State Space to capture non-local information. ROBE extends this to the RGB domain, employing a reconstruction network to address conflicting foreground and background regions identified as distortion-prone areas, which arise from their separate estimation by independent modules. As the stages progress, RUN gradually facilitates reversible modeling of foreground and background in both the mask and RGB domains, directing the network's attention to uncertain regions and mitigating false-positive and false-negative results. Extensive experiments demonstrate the superior performance of RUN and highlight the potential of unfolding-based frameworks for COS and other high-level vision tasks. We will release the code and models.
format Preprint
id arxiv_https___arxiv_org_abs_2501_18783
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle RUN: Reversible Unfolding Network for Concealed Object Segmentation
He, Chunming
Zhang, Rihan
Xiao, Fengyang
Fang, Chengyu
Tang, Longxiang
Zhang, Yulun
Kong, Linghe
Fan, Deng-Ping
Li, Kai
Farsiu, Sina
Computer Vision and Pattern Recognition
Existing concealed object segmentation (COS) methods frequently utilize reversible strategies to address uncertain regions. However, these approaches are typically restricted to the mask domain, leaving the potential of the RGB domain underexplored. To address this, we propose the Reversible Unfolding Network (RUN), which applies reversible strategies across both mask and RGB domains through a theoretically grounded framework, enabling accurate segmentation. RUN first formulates a novel COS model by incorporating an extra residual sparsity constraint to minimize segmentation uncertainties. The iterative optimization steps of the proposed model are then unfolded into a multistage network, with each step corresponding to a stage. Each stage of RUN consists of two reversible modules: the Segmentation-Oriented Foreground Separation (SOFS) module and the Reconstruction-Oriented Background Extraction (ROBE) module. SOFS applies the reversible strategy at the mask level and introduces Reversible State Space to capture non-local information. ROBE extends this to the RGB domain, employing a reconstruction network to address conflicting foreground and background regions identified as distortion-prone areas, which arise from their separate estimation by independent modules. As the stages progress, RUN gradually facilitates reversible modeling of foreground and background in both the mask and RGB domains, directing the network's attention to uncertain regions and mitigating false-positive and false-negative results. Extensive experiments demonstrate the superior performance of RUN and highlight the potential of unfolding-based frameworks for COS and other high-level vision tasks. We will release the code and models.
title RUN: Reversible Unfolding Network for Concealed Object Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2501.18783