Anisotropic Proximal Point Algorithm
Fuente:
arXiv
Salvato in:
| Autori principali: | , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2023
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866918264666324992 |
|---|---|
| author | Laude, Emanuel Patrinos, Panagiotis |
| author_facet | Laude, Emanuel Patrinos, Panagiotis |
| contents | In this paper we study a nonlinear dual space preconditioning approach for the relaxed Proximal Point Algorithm (PPA) with application to monotone and relatively cohypomonotone inclusions, called anisotropic PPA. The algorithm is an instance of Luque's nonlinear PPA wherein the nonlinear preconditioner is chosen as the gradient of a Legendre convex function. Since the preconditioned operator is nonmonotone in general, convergence cannot be shown using standard arguments, unless the preconditioner exhibits isotropy (preserves directions) as in existing literature. To address the broader applicability we show convergence along subsequences invoking a Bregman version of Fejér-monotonicity in the dual space. Via a nonlinear generalization of Moreau's decomposition for operators, we provide a dual interpretation of the algorithm in terms of a forward iteration applied to a $D$-firmly nonexpansive mapping which involves the Bregman resolvent. For a suitable preconditioner, convergence rates of arbitrary order are derived under a mild Hölder growth condition. Finally, we discuss an anisotropic generalization of the proximal augmented Lagrangian method obtained via the proposed scheme. This aligns with Rockafellar's generalized and sharp Lagrangian functions. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_09834 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Anisotropic Proximal Point Algorithm Laude, Emanuel Patrinos, Panagiotis Optimization and Control In this paper we study a nonlinear dual space preconditioning approach for the relaxed Proximal Point Algorithm (PPA) with application to monotone and relatively cohypomonotone inclusions, called anisotropic PPA. The algorithm is an instance of Luque's nonlinear PPA wherein the nonlinear preconditioner is chosen as the gradient of a Legendre convex function. Since the preconditioned operator is nonmonotone in general, convergence cannot be shown using standard arguments, unless the preconditioner exhibits isotropy (preserves directions) as in existing literature. To address the broader applicability we show convergence along subsequences invoking a Bregman version of Fejér-monotonicity in the dual space. Via a nonlinear generalization of Moreau's decomposition for operators, we provide a dual interpretation of the algorithm in terms of a forward iteration applied to a $D$-firmly nonexpansive mapping which involves the Bregman resolvent. For a suitable preconditioner, convergence rates of arbitrary order are derived under a mild Hölder growth condition. Finally, we discuss an anisotropic generalization of the proximal augmented Lagrangian method obtained via the proposed scheme. This aligns with Rockafellar's generalized and sharp Lagrangian functions. |
| title | Anisotropic Proximal Point Algorithm |
| topic | Optimization and Control |
| url | https://arxiv.org/abs/2312.09834 |