Impact of white noise in artificial neural networks trained for classification: performance and noise mitigation strategies
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909414810714112 |
|---|---|
| author | Semenova, Nadezhda Brunner, Daniel |
| author_facet | Semenova, Nadezhda Brunner, Daniel |
| contents | In recent years, the hardware implementation of neural networks, leveraging physical coupling and analog neurons has substantially increased in relevance. Such nonlinear and complex physical networks provide significant advantages in speed and energy efficiency, but are potentially susceptible to internal noise when compared to digital emulations of such networks. In this work, we consider how additive and multiplicative Gaussian white noise on the neuronal level can affect the accuracy of the network when applied for specific tasks and including a softmax function in the readout layer. We adapt several noise reduction techniques to the essential setting of classification tasks, which represent a large fraction of neural network computing. We find that these adjusted concepts are highly effective in mitigating the detrimental impact of noise. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_04354 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Impact of white noise in artificial neural networks trained for classification: performance and noise mitigation strategies Semenova, Nadezhda Brunner, Daniel Machine Learning Emerging Technologies In recent years, the hardware implementation of neural networks, leveraging physical coupling and analog neurons has substantially increased in relevance. Such nonlinear and complex physical networks provide significant advantages in speed and energy efficiency, but are potentially susceptible to internal noise when compared to digital emulations of such networks. In this work, we consider how additive and multiplicative Gaussian white noise on the neuronal level can affect the accuracy of the network when applied for specific tasks and including a softmax function in the readout layer. We adapt several noise reduction techniques to the essential setting of classification tasks, which represent a large fraction of neural network computing. We find that these adjusted concepts are highly effective in mitigating the detrimental impact of noise. |
| title | Impact of white noise in artificial neural networks trained for classification: performance and noise mitigation strategies |
| topic | Machine Learning Emerging Technologies |
| url | https://arxiv.org/abs/2411.04354 |