RPCANet++: Deep Interpretable Robust PCA for Sparse Object Segmentation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wu, Fengyi, Dai, Yimian, Zhang, Tianfang, Ding, Yixuan, Yang, Jian, Cheng, Ming-Ming, Peng, Zhenming
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915430692552704
author Wu, Fengyi
Dai, Yimian
Zhang, Tianfang
Ding, Yixuan
Yang, Jian
Cheng, Ming-Ming
Peng, Zhenming
author_facet Wu, Fengyi
Dai, Yimian
Zhang, Tianfang
Ding, Yixuan
Yang, Jian
Cheng, Ming-Ming
Peng, Zhenming
contents Robust principal component analysis (RPCA) decomposes an observation matrix into low-rank background and sparse object components. This capability has enabled its application in tasks ranging from image restoration to segmentation. However, traditional RPCA models suffer from computational burdens caused by matrix operations, reliance on finely tuned hyperparameters, and rigid priors that limit adaptability in dynamic scenarios. To solve these limitations, we propose RPCANet++, a sparse object segmentation framework that fuses the interpretability of RPCA with efficient deep architectures. Our approach unfolds a relaxed RPCA model into a structured network comprising a Background Approximation Module (BAM), an Object Extraction Module (OEM), and an Image Restoration Module (IRM). To mitigate inter-stage transmission loss in the BAM, we introduce a Memory-Augmented Module (MAM) to enhance background feature preservation, while a Deep Contrast Prior Module (DCPM) leverages saliency cues to expedite object extraction. Extensive experiments on diverse datasets demonstrate that RPCANet++ achieves state-of-the-art performance under various imaging scenarios. We further improve interpretability via visual and numerical low-rankness and sparsity measurements. By combining the theoretical strengths of RPCA with the efficiency of deep networks, our approach sets a new baseline for reliable and interpretable sparse object segmentation. Codes are available at our Project Webpage https://fengyiwu98.github.io/rpcanetx.
format Preprint
id arxiv_https___arxiv_org_abs_2508_04190
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle RPCANet++: Deep Interpretable Robust PCA for Sparse Object Segmentation
Wu, Fengyi
Dai, Yimian
Zhang, Tianfang
Ding, Yixuan
Yang, Jian
Cheng, Ming-Ming
Peng, Zhenming
Computer Vision and Pattern Recognition
Robust principal component analysis (RPCA) decomposes an observation matrix into low-rank background and sparse object components. This capability has enabled its application in tasks ranging from image restoration to segmentation. However, traditional RPCA models suffer from computational burdens caused by matrix operations, reliance on finely tuned hyperparameters, and rigid priors that limit adaptability in dynamic scenarios. To solve these limitations, we propose RPCANet++, a sparse object segmentation framework that fuses the interpretability of RPCA with efficient deep architectures. Our approach unfolds a relaxed RPCA model into a structured network comprising a Background Approximation Module (BAM), an Object Extraction Module (OEM), and an Image Restoration Module (IRM). To mitigate inter-stage transmission loss in the BAM, we introduce a Memory-Augmented Module (MAM) to enhance background feature preservation, while a Deep Contrast Prior Module (DCPM) leverages saliency cues to expedite object extraction. Extensive experiments on diverse datasets demonstrate that RPCANet++ achieves state-of-the-art performance under various imaging scenarios. We further improve interpretability via visual and numerical low-rankness and sparsity measurements. By combining the theoretical strengths of RPCA with the efficiency of deep networks, our approach sets a new baseline for reliable and interpretable sparse object segmentation. Codes are available at our Project Webpage https://fengyiwu98.github.io/rpcanetx.
title RPCANet++: Deep Interpretable Robust PCA for Sparse Object Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2508.04190