Blending Optimal Control and Biologically Plausible Learning for Noise-Robust Physical Neural Networks

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Sunada, Satoshi, Niiyama, Tomoaki, Kanno, Kazutaka, Nogami, Rin, Röhm, André, Awano, Takato, Uchida, Atsushi
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917936854204416
author Sunada, Satoshi
Niiyama, Tomoaki
Kanno, Kazutaka
Nogami, Rin
Röhm, André
Awano, Takato
Uchida, Atsushi
author_facet Sunada, Satoshi
Niiyama, Tomoaki
Kanno, Kazutaka
Nogami, Rin
Röhm, André
Awano, Takato
Uchida, Atsushi
contents The rapidly increasing computational demands for artificial intelligence (AI) have spurred the exploration of computing principles beyond conventional digital computers. Physical neural networks (PNNs) offer efficient neuromorphic information processing by harnessing the innate computational power of physical processes; however, training their weight parameters is computationally expensive. We propose a training approach for substantially reducing this training cost. Our training approach merges an optimal control method for continuous-time dynamical systems with a biologically plausible training method--direct feedback alignment. In addition to the reduction of training time, this approach achieves robust processing even under measurement errors and noise without requiring detailed system information. The effectiveness was numerically and experimentally verified in an optoelectronic delay system. Our approach significantly extends the range of physical systems practically usable as PNNs.
format Preprint
id arxiv_https___arxiv_org_abs_2502_19053
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Blending Optimal Control and Biologically Plausible Learning for Noise-Robust Physical Neural Networks
Sunada, Satoshi
Niiyama, Tomoaki
Kanno, Kazutaka
Nogami, Rin
Röhm, André
Awano, Takato
Uchida, Atsushi
Applied Physics
Emerging Technologies
Machine Learning
Neural and Evolutionary Computing
The rapidly increasing computational demands for artificial intelligence (AI) have spurred the exploration of computing principles beyond conventional digital computers. Physical neural networks (PNNs) offer efficient neuromorphic information processing by harnessing the innate computational power of physical processes; however, training their weight parameters is computationally expensive. We propose a training approach for substantially reducing this training cost. Our training approach merges an optimal control method for continuous-time dynamical systems with a biologically plausible training method--direct feedback alignment. In addition to the reduction of training time, this approach achieves robust processing even under measurement errors and noise without requiring detailed system information. The effectiveness was numerically and experimentally verified in an optoelectronic delay system. Our approach significantly extends the range of physical systems practically usable as PNNs.
title Blending Optimal Control and Biologically Plausible Learning for Noise-Robust Physical Neural Networks
topic Applied Physics
Emerging Technologies
Machine Learning
Neural and Evolutionary Computing
url https://arxiv.org/abs/2502.19053