Circuit realization and hardware linearization of monotone operator equilibrium networks
Fuente:
arXiv
Salvato in:
| Autore principale: | |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866908544244121600 |
|---|---|
| author | Chaffey, Thomas |
| author_facet | Chaffey, Thomas |
| contents | It is shown that the port behavior of a resistor-diode network corresponds to the solution of a ReLU monotone operator equilibrium network (a neural network in the limit of infinite depth), giving a parsimonious construction of a neural network in analog hardware. We furthermore show that the gradient of such a circuit can be computed directly in hardware, using a procedure we call hardware linearization. This allows the network to be trained in hardware, which we demonstrate with a device-level circuit simulation. We extend the results to cascades of resistor-diode networks, which can be used to implement feedforward and other asymmetric networks. We finally show that different nonlinear elements give rise to different activation functions, and introduce the novel diode ReLU which is induced by a non-ideal diode model. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_13793 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Circuit realization and hardware linearization of monotone operator equilibrium networks Chaffey, Thomas Systems and Control Machine Learning Neural and Evolutionary Computing Optimization and Control 65K10, 68T05, 93B30, 93D99 It is shown that the port behavior of a resistor-diode network corresponds to the solution of a ReLU monotone operator equilibrium network (a neural network in the limit of infinite depth), giving a parsimonious construction of a neural network in analog hardware. We furthermore show that the gradient of such a circuit can be computed directly in hardware, using a procedure we call hardware linearization. This allows the network to be trained in hardware, which we demonstrate with a device-level circuit simulation. We extend the results to cascades of resistor-diode networks, which can be used to implement feedforward and other asymmetric networks. We finally show that different nonlinear elements give rise to different activation functions, and introduce the novel diode ReLU which is induced by a non-ideal diode model. |
| title | Circuit realization and hardware linearization of monotone operator equilibrium networks |
| topic | Systems and Control Machine Learning Neural and Evolutionary Computing Optimization and Control 65K10, 68T05, 93B30, 93D99 |
| url | https://arxiv.org/abs/2509.13793 |