Optoelectronic recurrent neural network using optical-electrical-optical converters with RC delay
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917847747264512 |
|---|---|
| author | Arahata, Masaya Kita, Shota Aoyama, Kazuo Shinya, Akihiko Sawada, Hiroshi Notomi, Masaya |
| author_facet | Arahata, Masaya Kita, Shota Aoyama, Kazuo Shinya, Akihiko Sawada, Hiroshi Notomi, Masaya |
| contents | Optical neural network (ONN) has been attracting intense attention owing to their low latency and low-power consumption. Among the ONNs, optical recurrent neural network (RNN) enables low-power and high-speed time-series data processing using a compact loop structure. The loop losses need to be efficiently compensated so that the time-series information is maintained in the RNN operation. For this purpose, we focus on the optoelectronic RNN (OE-RNN) with optical-electrical-optical (OEO) converters to compensate for the loop losses. However, the effect of resistive-capacitive (RC) delay of OEO converters on the RNN performance is unclear. Here, we study in simulation an OE-RNN equipped with OEO converters with RC delay. We confirm that our modeled OE-RNN achieves the high training accuracy of time-series data classification even when RC delay is comparably large to the time interval of time-series data. Our analyses reveal that the accumulation of time-series data by RC delay does not degrade the RNN performance but rather can compensate for the degraded RNN performance due to loop losses. From the theoretical analysis referring to the gradient explosion and vanishing problems, we find the region related to loss and RC delay where the high training accuracy can be achieved. In simulation, we confirm this compensation effect in the large OE-RNN circuit up to 32$\times$32 scale. Our proposed scheme opens a new way of time-series data processing by utilizing RC delay for the optical computing and optical communication. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_16186 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Optoelectronic recurrent neural network using optical-electrical-optical converters with RC delay Arahata, Masaya Kita, Shota Aoyama, Kazuo Shinya, Akihiko Sawada, Hiroshi Notomi, Masaya Optics Optical neural network (ONN) has been attracting intense attention owing to their low latency and low-power consumption. Among the ONNs, optical recurrent neural network (RNN) enables low-power and high-speed time-series data processing using a compact loop structure. The loop losses need to be efficiently compensated so that the time-series information is maintained in the RNN operation. For this purpose, we focus on the optoelectronic RNN (OE-RNN) with optical-electrical-optical (OEO) converters to compensate for the loop losses. However, the effect of resistive-capacitive (RC) delay of OEO converters on the RNN performance is unclear. Here, we study in simulation an OE-RNN equipped with OEO converters with RC delay. We confirm that our modeled OE-RNN achieves the high training accuracy of time-series data classification even when RC delay is comparably large to the time interval of time-series data. Our analyses reveal that the accumulation of time-series data by RC delay does not degrade the RNN performance but rather can compensate for the degraded RNN performance due to loop losses. From the theoretical analysis referring to the gradient explosion and vanishing problems, we find the region related to loss and RC delay where the high training accuracy can be achieved. In simulation, we confirm this compensation effect in the large OE-RNN circuit up to 32$\times$32 scale. Our proposed scheme opens a new way of time-series data processing by utilizing RC delay for the optical computing and optical communication. |
| title | Optoelectronic recurrent neural network using optical-electrical-optical converters with RC delay |
| topic | Optics |
| url | https://arxiv.org/abs/2411.16186 |