Saved in:
Bibliographic Details
Main Authors: Lee, Ching-pei, Wright, Stephen J.
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2602.10470
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912896791871488
author Lee, Ching-pei
Wright, Stephen J.
author_facet Lee, Ching-pei
Wright, Stephen J.
contents We describe inexact proximal Newton-like methods for solving degenerate regularized optimization problems and for the broader problem of finding a zero of a generalized equation that is the sum of a continuous map and a maximal monotone operator. Superlinear convergence for both the distance to the solution set and a certain measure of first-order optimality can be achieved under a Hölderian error bound condition, including for problems in which the continuous map is nonmonotone, with Jacobian singular at the solution and not Lipschitz. Superlinear convergence is attainable even when the Jacobian is merely uniformly continuous, relaxing the standard Lipschitz assumption to its theoretical limit. For convex regularized optimization problems, we introduce a novel globalization strategy that ensures strict objective decrease and avoids the Maratos effect, attaining local $Q$-superlinear convergence without prior knowledge of problem parameters. Unit step size acceptance in our line search strategy does not rely on continuity or even existence of the Hessian of the smooth term in the objective, making the framework compatible with other potential candidates for superlinearly convergent updates.
format Preprint
id arxiv_https___arxiv_org_abs_2602_10470
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Revisiting Superlinear Convergence of Proximal Newton-Like Methods to Degenerate Solutions
Lee, Ching-pei
Wright, Stephen J.
Optimization and Control
We describe inexact proximal Newton-like methods for solving degenerate regularized optimization problems and for the broader problem of finding a zero of a generalized equation that is the sum of a continuous map and a maximal monotone operator. Superlinear convergence for both the distance to the solution set and a certain measure of first-order optimality can be achieved under a Hölderian error bound condition, including for problems in which the continuous map is nonmonotone, with Jacobian singular at the solution and not Lipschitz. Superlinear convergence is attainable even when the Jacobian is merely uniformly continuous, relaxing the standard Lipschitz assumption to its theoretical limit. For convex regularized optimization problems, we introduce a novel globalization strategy that ensures strict objective decrease and avoids the Maratos effect, attaining local $Q$-superlinear convergence without prior knowledge of problem parameters. Unit step size acceptance in our line search strategy does not rely on continuity or even existence of the Hessian of the smooth term in the objective, making the framework compatible with other potential candidates for superlinearly convergent updates.
title Revisiting Superlinear Convergence of Proximal Newton-Like Methods to Degenerate Solutions
topic Optimization and Control
url https://arxiv.org/abs/2602.10470