Variable Projected Augmented Lagrangian Methods for Generalized Lasso Problems

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Aleotti, Stefano, Bianchi, Davide, Bossmann, Florian, Chen, Riley Yizhou, Chung, Matthias
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911236507041792
author Aleotti, Stefano
Bianchi, Davide
Bossmann, Florian
Chen, Riley Yizhou
Chung, Matthias
author_facet Aleotti, Stefano
Bianchi, Davide
Bossmann, Florian
Chen, Riley Yizhou
Chung, Matthias
contents We introduce variable projected augmented Lagrangian (VPAL) methods for solving generalized nonlinear Lasso problems with improved speed and accuracy. By eliminating the nonsmooth variable via soft-thresholding, VPAL transforms the problem into a smooth reduced formulation. For linear models, we develop a preconditioned variant that mimics Newton-type updates and yields significant acceleration. We prove convergence guarantees for both standard and preconditioned VPAL under mild assumptions and show that variable projection leads to sharper convergence and higher solution quality. The method seamlessly extends to nonlinear inverse problems, where it outperforms traditional approaches in applications such as phase retrieval and contrast enhanced MRI (LIP-CAR). Across tasks including deblurring, inpainting, and sparse-view tomography, VPAL consistently delivers state-of-the-art reconstructions, positioning variable projection as a powerful tool for modern large-scale inverse problems.
format Preprint
id arxiv_https___arxiv_org_abs_2510_24140
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Variable Projected Augmented Lagrangian Methods for Generalized Lasso Problems
Aleotti, Stefano
Bianchi, Davide
Bossmann, Florian
Chen, Riley Yizhou
Chung, Matthias
Optimization and Control
Numerical Analysis
65K10, 65J22, 65F22, 90C25, 94A08, 68T07
We introduce variable projected augmented Lagrangian (VPAL) methods for solving generalized nonlinear Lasso problems with improved speed and accuracy. By eliminating the nonsmooth variable via soft-thresholding, VPAL transforms the problem into a smooth reduced formulation. For linear models, we develop a preconditioned variant that mimics Newton-type updates and yields significant acceleration. We prove convergence guarantees for both standard and preconditioned VPAL under mild assumptions and show that variable projection leads to sharper convergence and higher solution quality. The method seamlessly extends to nonlinear inverse problems, where it outperforms traditional approaches in applications such as phase retrieval and contrast enhanced MRI (LIP-CAR). Across tasks including deblurring, inpainting, and sparse-view tomography, VPAL consistently delivers state-of-the-art reconstructions, positioning variable projection as a powerful tool for modern large-scale inverse problems.
title Variable Projected Augmented Lagrangian Methods for Generalized Lasso Problems
topic Optimization and Control
Numerical Analysis
65K10, 65J22, 65F22, 90C25, 94A08, 68T07
url https://arxiv.org/abs/2510.24140