Convergence analysis of a regularized Newton method with generalized regularization terms for convex optimization problems

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Yamakawa, Yuya, Yamashita, Nobuo
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913424217210880
author Yamakawa, Yuya
Yamashita, Nobuo
author_facet Yamakawa, Yuya
Yamashita, Nobuo
contents This paper presents a regularized Newton method (RNM) with generalized regularization terms for unconstrained convex optimization problems. The generalized regularization includes quadratic, cubic, and elastic net regularizations as special cases. Therefore, the proposed method serves as a general framework that includes not only the classical and cubic RNMs but also a novel RNM with elastic net regularization. We show that the proposed RNM has the global $\mathcal{O}(k^{-2})$ and local superlinear convergence, which are the same as those of the cubic RNM.
format Preprint
id arxiv_https___arxiv_org_abs_2406_09786
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Convergence analysis of a regularized Newton method with generalized regularization terms for convex optimization problems
Yamakawa, Yuya
Yamashita, Nobuo
Optimization and Control
This paper presents a regularized Newton method (RNM) with generalized regularization terms for unconstrained convex optimization problems. The generalized regularization includes quadratic, cubic, and elastic net regularizations as special cases. Therefore, the proposed method serves as a general framework that includes not only the classical and cubic RNMs but also a novel RNM with elastic net regularization. We show that the proposed RNM has the global $\mathcal{O}(k^{-2})$ and local superlinear convergence, which are the same as those of the cubic RNM.
title Convergence analysis of a regularized Newton method with generalized regularization terms for convex optimization problems
topic Optimization and Control
url https://arxiv.org/abs/2406.09786