Sparsity-Enhanced Multilayered Non-Convex Regularization with Epigraphical Relaxation for Debiased Signal Recovery

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Katsuma, Akari, Kyochi, Seisuke, Ono, Shunsuke, Selesnick, Ivan
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912040501641216
author Katsuma, Akari
Kyochi, Seisuke
Ono, Shunsuke
Selesnick, Ivan
author_facet Katsuma, Akari
Kyochi, Seisuke
Ono, Shunsuke
Selesnick, Ivan
contents This paper proposes a precise signal recovery method with multilayered non-convex regularization, enhancing sparsity/low-rankness for high-dimensional signals including images and videos. In optimization-based signal recovery, multilayered convex regularization functions based on the L1 and nuclear-norms not only guarantee a global optimal solution but also offer more accurate estimation than single-layered ones, thanks to their faithful modeling of structured sparsity and low-rankness in high-dimensional signals. However, these functions are known to yield biased solutions (estimated with smaller amplitude values than the true ones). To address this issue, multilayered non-convex regularization functions have been considered, although they face their own challenges: 1) their closed-form proximity operators are unavailable, and 2) convergence may result in a local optimal solution. In this paper, we resolve the two issues with an approach based on epigraphical relaxation (ER). First, ER decomposes a multilayered non-convex regularization function into the outermost function and epigraph constraints for the inner functions, facilitating the computation of proximity operators. Second, the relaxed regularization functions by ER are integrated into a non-convexly regularized convex optimization model to estimate a global optimal solution with less bias. Numerical experiments demonstrate the bias reduction achieved by the proposed method in image recovery and principal component analysis.
format Preprint
id arxiv_https___arxiv_org_abs_2409_14768
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Sparsity-Enhanced Multilayered Non-Convex Regularization with Epigraphical Relaxation for Debiased Signal Recovery
Katsuma, Akari
Kyochi, Seisuke
Ono, Shunsuke
Selesnick, Ivan
Signal Processing
Optimization and Control
This paper proposes a precise signal recovery method with multilayered non-convex regularization, enhancing sparsity/low-rankness for high-dimensional signals including images and videos. In optimization-based signal recovery, multilayered convex regularization functions based on the L1 and nuclear-norms not only guarantee a global optimal solution but also offer more accurate estimation than single-layered ones, thanks to their faithful modeling of structured sparsity and low-rankness in high-dimensional signals. However, these functions are known to yield biased solutions (estimated with smaller amplitude values than the true ones). To address this issue, multilayered non-convex regularization functions have been considered, although they face their own challenges: 1) their closed-form proximity operators are unavailable, and 2) convergence may result in a local optimal solution. In this paper, we resolve the two issues with an approach based on epigraphical relaxation (ER). First, ER decomposes a multilayered non-convex regularization function into the outermost function and epigraph constraints for the inner functions, facilitating the computation of proximity operators. Second, the relaxed regularization functions by ER are integrated into a non-convexly regularized convex optimization model to estimate a global optimal solution with less bias. Numerical experiments demonstrate the bias reduction achieved by the proposed method in image recovery and principal component analysis.
title Sparsity-Enhanced Multilayered Non-Convex Regularization with Epigraphical Relaxation for Debiased Signal Recovery
topic Signal Processing
Optimization and Control
url https://arxiv.org/abs/2409.14768