QuasiNet: a neural network with trainable product layers
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911783554383872 |
|---|---|
| author | Malinovská, Kristína Holenda, Slavomír Malinovský, Ľudovít |
| author_facet | Malinovská, Kristína Holenda, Slavomír Malinovský, Ľudovít |
| contents | Classical neural networks achieve only limited convergence in hard problems such as XOR or parity when the number of hidden neurons is small. With the motivation to improve the success rate of neural networks in these problems, we propose a new neural network model inspired by existing neural network models with so called product neurons and a learning rule derived from classical error backpropagation, which elegantly solves the problem of mutually exclusive situations. Unlike existing product neurons, which have weights that are preset and not adaptable, our product layers of neurons also do learn. We tested the model and compared its success rate to a classical multilayer perceptron in the aforementioned problems as well as in other hard problems such as the two spirals. Our results indicate that our model is clearly more successful than the classical MLP and has the potential to be used in many tasks and applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_06137 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | QuasiNet: a neural network with trainable product layers Malinovská, Kristína Holenda, Slavomír Malinovský, Ľudovít Neural and Evolutionary Computing Artificial Intelligence Machine Learning I.2.0 Classical neural networks achieve only limited convergence in hard problems such as XOR or parity when the number of hidden neurons is small. With the motivation to improve the success rate of neural networks in these problems, we propose a new neural network model inspired by existing neural network models with so called product neurons and a learning rule derived from classical error backpropagation, which elegantly solves the problem of mutually exclusive situations. Unlike existing product neurons, which have weights that are preset and not adaptable, our product layers of neurons also do learn. We tested the model and compared its success rate to a classical multilayer perceptron in the aforementioned problems as well as in other hard problems such as the two spirals. Our results indicate that our model is clearly more successful than the classical MLP and has the potential to be used in many tasks and applications. |
| title | QuasiNet: a neural network with trainable product layers |
| topic | Neural and Evolutionary Computing Artificial Intelligence Machine Learning I.2.0 |
| url | https://arxiv.org/abs/2401.06137 |