New complementarity formulations for root-finding and optimization of piecewise-affine functions in abs-normal form

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhang, Yulan, Khan, Kamil A.
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909470182866944
author Zhang, Yulan
Khan, Kamil A.
author_facet Zhang, Yulan
Khan, Kamil A.
contents Nonsmooth functions have been used to model discrete-continuous phenomena such as contact mechanics, and are also prevalent in neural network formulations via activation functions such as ReLU. At previous AD conferences, Griewank et al. showed that nonsmooth functions may be approximated well by piecewise-affine functions constructed using an AD-like procedure. Moreover, such a piecewise-affine function may always be represented in an "abs-normal form", encoding it as a collection of four matrices and two vectors. We present new general complementarity formulations for root-finding and optimization of piecewise-affine functions in abs-normal form, with significantly fewer restrictions than previous approaches. In particular, piecewise-affine root-finding may always be represented as a mixed-linear complementarity problem (MLCP), which may often be simplified to a linear complementarity problem (LCP). We also present approaches for verifying existence of solutions to these problems. A proof-of-concept implementation in Julia is discussed and applied to several numerical examples, using the PATH solver to solve complementarity problems.
format Preprint
id arxiv_https___arxiv_org_abs_2501_18503
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle New complementarity formulations for root-finding and optimization of piecewise-affine functions in abs-normal form
Zhang, Yulan
Khan, Kamil A.
Optimization and Control
Numerical Analysis
Nonsmooth functions have been used to model discrete-continuous phenomena such as contact mechanics, and are also prevalent in neural network formulations via activation functions such as ReLU. At previous AD conferences, Griewank et al. showed that nonsmooth functions may be approximated well by piecewise-affine functions constructed using an AD-like procedure. Moreover, such a piecewise-affine function may always be represented in an "abs-normal form", encoding it as a collection of four matrices and two vectors. We present new general complementarity formulations for root-finding and optimization of piecewise-affine functions in abs-normal form, with significantly fewer restrictions than previous approaches. In particular, piecewise-affine root-finding may always be represented as a mixed-linear complementarity problem (MLCP), which may often be simplified to a linear complementarity problem (LCP). We also present approaches for verifying existence of solutions to these problems. A proof-of-concept implementation in Julia is discussed and applied to several numerical examples, using the PATH solver to solve complementarity problems.
title New complementarity formulations for root-finding and optimization of piecewise-affine functions in abs-normal form
topic Optimization and Control
Numerical Analysis
url https://arxiv.org/abs/2501.18503