Few-Shot Neuromorphic Vision in a Nonlinear Photonic Network Laser

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Ng, Wai Kit, Dranczewski, Jakub, Fischer, Anna, Raziman, T V, Saxena, Dhruv, Farchy, Tobias, Stenning, Kilian, Peters, Jonathan, Schmid, Heinz, Branford, Will R, Barahona, Mauricio, Moselund, Kirsten, Sapienza, Riccardo, Gartside, Jack C.
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866918383860056064
author Ng, Wai Kit
Dranczewski, Jakub
Fischer, Anna
Raziman, T V
Saxena, Dhruv
Farchy, Tobias
Stenning, Kilian
Peters, Jonathan
Schmid, Heinz
Branford, Will R
Barahona, Mauricio
Moselund, Kirsten
Sapienza, Riccardo
Gartside, Jack C.
author_facet Ng, Wai Kit
Dranczewski, Jakub
Fischer, Anna
Raziman, T V
Saxena, Dhruv
Farchy, Tobias
Stenning, Kilian
Peters, Jonathan
Schmid, Heinz
Branford, Will R
Barahona, Mauricio
Moselund, Kirsten
Sapienza, Riccardo
Gartside, Jack C.
contents With the growing prevalence of AI, demand increases for hardware that mimics the brain's ability to extract structure from limited data. In the retina, ganglion cells detect features from sparse inputs via lateral inhibition, where neurons antagonistically suppress activity of neighbouring cells. Biological neurons exhibit diverse heterogeneous nonlinear responses, linked to robust learning and strong performance in low-data regimes. Here, we introduce a retinally-inspired photonic computing system where spatially-competing lasing modes in a random network laser act as heterogeneous, inhibitively-coupled neurons - enabling feature detection, few-shot classification, and segmentation. This silicon-compatible scheme harnesses heterogeneous excitatory and inhibitory nonlinear physical dynamics which give rise to emergent photonic computing behaviour, including parallel feature detection and strong performance when training data is scarce. We report 98.05% and 87.85% accuracy on MNIST and Fashion-MNIST, and 90.12% on BreaKHis cancer diagnosis - outperforming software CNNs including EfficientNetV2 and the vision transformer ViT in few-shot and class-imbalanced regimes with training sets of up to several hundred images. We demonstrate combined segmentation and classification on the HAM10k skin lesion dataset, achieving DICE and Jaccard scores of 84.49% and 74.80%. These results demonstrate the potential of random lasing networks as nonlinear photonic learning systems, and highlight the ability of heterogeneous nonlinear dynamics to support strong learning in challenging low-data scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2407_15558
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Few-Shot Neuromorphic Vision in a Nonlinear Photonic Network Laser
Ng, Wai Kit
Dranczewski, Jakub
Fischer, Anna
Raziman, T V
Saxena, Dhruv
Farchy, Tobias
Stenning, Kilian
Peters, Jonathan
Schmid, Heinz
Branford, Will R
Barahona, Mauricio
Moselund, Kirsten
Sapienza, Riccardo
Gartside, Jack C.
Disordered Systems and Neural Networks
Mesoscale and Nanoscale Physics
Materials Science
Optics
With the growing prevalence of AI, demand increases for hardware that mimics the brain's ability to extract structure from limited data. In the retina, ganglion cells detect features from sparse inputs via lateral inhibition, where neurons antagonistically suppress activity of neighbouring cells. Biological neurons exhibit diverse heterogeneous nonlinear responses, linked to robust learning and strong performance in low-data regimes. Here, we introduce a retinally-inspired photonic computing system where spatially-competing lasing modes in a random network laser act as heterogeneous, inhibitively-coupled neurons - enabling feature detection, few-shot classification, and segmentation. This silicon-compatible scheme harnesses heterogeneous excitatory and inhibitory nonlinear physical dynamics which give rise to emergent photonic computing behaviour, including parallel feature detection and strong performance when training data is scarce. We report 98.05% and 87.85% accuracy on MNIST and Fashion-MNIST, and 90.12% on BreaKHis cancer diagnosis - outperforming software CNNs including EfficientNetV2 and the vision transformer ViT in few-shot and class-imbalanced regimes with training sets of up to several hundred images. We demonstrate combined segmentation and classification on the HAM10k skin lesion dataset, achieving DICE and Jaccard scores of 84.49% and 74.80%. These results demonstrate the potential of random lasing networks as nonlinear photonic learning systems, and highlight the ability of heterogeneous nonlinear dynamics to support strong learning in challenging low-data scenarios.
title Few-Shot Neuromorphic Vision in a Nonlinear Photonic Network Laser
topic Disordered Systems and Neural Networks
Mesoscale and Nanoscale Physics
Materials Science
Optics
url https://arxiv.org/abs/2407.15558