Difference of Convex (DC) approach for neural network approximation with uniform loss function
Fuente:
arXiv
Salvato in:
| Autori principali: | , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917191574618112 |
|---|---|
| author | Peiris, Vinesha Sukhorukova, Nadezda |
| author_facet | Peiris, Vinesha Sukhorukova, Nadezda |
| contents | Neural networks (NNs) can be viewed as approximation tools. Traditionally, NNs are relying on gradient and stochastic gradient (SG) methods. There are a number of available computational packages for constructing least squares approximations, while uniform (minimax) approximations are hard due to their nonsmooth nature. It was recently demonstrated that a difference convex (DC) programming approach is an efficient alternative optimiser for NNs. In this paper, we demonstrate that a DC programming approach is also efficient for minimax approximation. In our numerical experiments, we compare a DC-programming approach and ADAMAX, a commonly used method for minimax NN approximations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_05557 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Difference of Convex (DC) approach for neural network approximation with uniform loss function Peiris, Vinesha Sukhorukova, Nadezda Optimization and Control 90C26, 65K05, 41A50, 90C47, 90C90 Neural networks (NNs) can be viewed as approximation tools. Traditionally, NNs are relying on gradient and stochastic gradient (SG) methods. There are a number of available computational packages for constructing least squares approximations, while uniform (minimax) approximations are hard due to their nonsmooth nature. It was recently demonstrated that a difference convex (DC) programming approach is an efficient alternative optimiser for NNs. In this paper, we demonstrate that a DC programming approach is also efficient for minimax approximation. In our numerical experiments, we compare a DC-programming approach and ADAMAX, a commonly used method for minimax NN approximations. |
| title | Difference of Convex (DC) approach for neural network approximation with uniform loss function |
| topic | Optimization and Control 90C26, 65K05, 41A50, 90C47, 90C90 |
| url | https://arxiv.org/abs/2601.05557 |