Gradient descent in materia through homodyne gradient extraction
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2021
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915093012283392 |
|---|---|
| author | Boon, Marcus N. Cassola, Lorenzo Euler, Hans-Christian Ruiz Chen, Tao van de Ven, Bram Ibarra, Unai Alegre Bobbert, Peter A. van der Wiel, Wilfred G. |
| author_facet | Boon, Marcus N. Cassola, Lorenzo Euler, Hans-Christian Ruiz Chen, Tao van de Ven, Bram Ibarra, Unai Alegre Bobbert, Peter A. van der Wiel, Wilfred G. |
| contents | Deep learning, a multi-layered neural network approach inspired by the brain, has revolutionized machine learning. One of its key enablers has been backpropagation, an algorithm that computes the gradient of a loss function with respect to the weights and biases in the neural network model, in combination with its use in gradient descent. However, the implementation of deep learning in digital computers is intrinsically energy hungry, with energy consumption becoming prohibitively high for many applications. This has stimulated the development of specialized hardware, ranging from neuromorphic CMOS integrated circuits and integrated photonic tensor cores to unconventional, material-based computing system. The learning process in these material systems, realized, e.g., by artificial evolution, equilibrium propagation or surrogate modelling, is a complicated and time-consuming process. Here, we demonstrate a simple yet efficient and accurate gradient extraction method, based on the principle of homodyne detection, for performing gradient descent on a loss function directly in a physical system without the need of an analytical description. By perturbing the parameters that need to be optimized using sinusoidal waveforms with distinct frequencies, we effectively obtain the gradient information in a highly robust and scalable manner. We illustrate the method in dopant network processing units, but argue that it is applicable in a wide range of physical systems. Homodyne gradient extraction can in principle be fully implemented in materia, facilitating the development of autonomously learning material systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2105_11233 |
| institution | arXiv |
| publishDate | 2021 |
| record_format | arxiv |
| spellingShingle | Gradient descent in materia through homodyne gradient extraction Boon, Marcus N. Cassola, Lorenzo Euler, Hans-Christian Ruiz Chen, Tao van de Ven, Bram Ibarra, Unai Alegre Bobbert, Peter A. van der Wiel, Wilfred G. Neural and Evolutionary Computing Emerging Technologies Machine Learning Deep learning, a multi-layered neural network approach inspired by the brain, has revolutionized machine learning. One of its key enablers has been backpropagation, an algorithm that computes the gradient of a loss function with respect to the weights and biases in the neural network model, in combination with its use in gradient descent. However, the implementation of deep learning in digital computers is intrinsically energy hungry, with energy consumption becoming prohibitively high for many applications. This has stimulated the development of specialized hardware, ranging from neuromorphic CMOS integrated circuits and integrated photonic tensor cores to unconventional, material-based computing system. The learning process in these material systems, realized, e.g., by artificial evolution, equilibrium propagation or surrogate modelling, is a complicated and time-consuming process. Here, we demonstrate a simple yet efficient and accurate gradient extraction method, based on the principle of homodyne detection, for performing gradient descent on a loss function directly in a physical system without the need of an analytical description. By perturbing the parameters that need to be optimized using sinusoidal waveforms with distinct frequencies, we effectively obtain the gradient information in a highly robust and scalable manner. We illustrate the method in dopant network processing units, but argue that it is applicable in a wide range of physical systems. Homodyne gradient extraction can in principle be fully implemented in materia, facilitating the development of autonomously learning material systems. |
| title | Gradient descent in materia through homodyne gradient extraction |
| topic | Neural and Evolutionary Computing Emerging Technologies Machine Learning |
| url | https://arxiv.org/abs/2105.11233 |