All-Optical, Reconfigurable and Power Independent Neural Activation Function by Means of Phase Modulation
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910319471755264 |
|---|---|
| author | Sarantoglou, George Bogris, Adonis Mesaritakis, Charis |
| author_facet | Sarantoglou, George Bogris, Adonis Mesaritakis, Charis |
| contents | In this work, we present numerical results concerning an integrated photonic non-linear activation function that relies on a power independent, non-linear phase to amplitude conversion in a passive optical resonator. The underlying mechanism is universal to all optical filters, whereas here, simulations were based on micro-ring resonators (MRRs). Investigation revealed that the photonic neural node can be tuned to support a wide variety of continuous activation functions that are relevant to the neural network architectures, such as the sigmoid and the softplus functions. The proposed photonic node is numerically evaluated in the context of time delayed reservoir computing (TDRC) scheme, targeting the one-step ahead prediction of the Santa Fe series. The proposed phase to amplitude TDRC is benchmarked versus the conventional amplitude based TDRC, showcasing a performance boost by one order of magnitude. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_03778 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | All-Optical, Reconfigurable and Power Independent Neural Activation Function by Means of Phase Modulation Sarantoglou, George Bogris, Adonis Mesaritakis, Charis Optics Signal Processing In this work, we present numerical results concerning an integrated photonic non-linear activation function that relies on a power independent, non-linear phase to amplitude conversion in a passive optical resonator. The underlying mechanism is universal to all optical filters, whereas here, simulations were based on micro-ring resonators (MRRs). Investigation revealed that the photonic neural node can be tuned to support a wide variety of continuous activation functions that are relevant to the neural network architectures, such as the sigmoid and the softplus functions. The proposed photonic node is numerically evaluated in the context of time delayed reservoir computing (TDRC) scheme, targeting the one-step ahead prediction of the Santa Fe series. The proposed phase to amplitude TDRC is benchmarked versus the conventional amplitude based TDRC, showcasing a performance boost by one order of magnitude. |
| title | All-Optical, Reconfigurable and Power Independent Neural Activation Function by Means of Phase Modulation |
| topic | Optics Signal Processing |
| url | https://arxiv.org/abs/2402.03778 |