A Scale-Shape Dual Newton Method for Entropic Least Squares
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866914518032973824 |
|---|---|
| author | Barnfield, Nicholas Burke, James V. Friedlander, Michael P. Hoheisel, Tim |
| author_facet | Barnfield, Nicholas Burke, James V. Friedlander, Michael P. Hoheisel, Tim |
| contents | We give a damped inexact Newton method for entropy-regularized least-squares on the nonnegative orthant that converges globally at a linear rate with $O(\logε^{-1})$ iteration complexity, locally at a superlinear-to-quadratic rate, and is immune to the finite-precision overflow that limits classical dual solvers. A scale-shape decomposition of the primal -- separating its scale from its direction -- produces a dual with a nonsingular Jacobian. Objectives and Jacobians are evaluated through stable log-sum-exp and softmax primitives. Lambert W bounds on the scale uniformly control the Jacobian's spectrum, from which both rates follow. The solution map is jointly Lipschitz in the data, regularization parameter, and reference measure, and extends continuously to the vanishing-regularization limit. Experiments on a problem from analytic continuation of quantum Monte Carlo data confirm the predicted overflow resilience and convergence behavior. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_27154 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | A Scale-Shape Dual Newton Method for Entropic Least Squares Barnfield, Nicholas Burke, James V. Friedlander, Michael P. Hoheisel, Tim Optimization and Control Numerical Analysis 90C25, 90C53, 65K05, 49N15 We give a damped inexact Newton method for entropy-regularized least-squares on the nonnegative orthant that converges globally at a linear rate with $O(\logε^{-1})$ iteration complexity, locally at a superlinear-to-quadratic rate, and is immune to the finite-precision overflow that limits classical dual solvers. A scale-shape decomposition of the primal -- separating its scale from its direction -- produces a dual with a nonsingular Jacobian. Objectives and Jacobians are evaluated through stable log-sum-exp and softmax primitives. Lambert W bounds on the scale uniformly control the Jacobian's spectrum, from which both rates follow. The solution map is jointly Lipschitz in the data, regularization parameter, and reference measure, and extends continuously to the vanishing-regularization limit. Experiments on a problem from analytic continuation of quantum Monte Carlo data confirm the predicted overflow resilience and convergence behavior. |
| title | A Scale-Shape Dual Newton Method for Entropic Least Squares |
| topic | Optimization and Control Numerical Analysis 90C25, 90C53, 65K05, 49N15 |
| url | https://arxiv.org/abs/2604.27154 |