Low-power multi-mode fiber projector overcomes shallow neural networks classifiers

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Ancora, Daniele, Negri, Matteo, Gianfrate, Antonio, Trypogeorgos, Dimitris, Dominici, Lorenzo, Sanvitto, Daniele, Ricci-Tersenghi, Federico, Leuzzi, Luca
Formato: Preprint
Publicado: 2022
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912305764106240
author Ancora, Daniele
Negri, Matteo
Gianfrate, Antonio
Trypogeorgos, Dimitris
Dominici, Lorenzo
Sanvitto, Daniele
Ricci-Tersenghi, Federico
Leuzzi, Luca
author_facet Ancora, Daniele
Negri, Matteo
Gianfrate, Antonio
Trypogeorgos, Dimitris
Dominici, Lorenzo
Sanvitto, Daniele
Ricci-Tersenghi, Federico
Leuzzi, Luca
contents In the domain of disordered photonics, the characterization of optically opaque materials for light manipulation and imaging is a primary aim. Among various complex devices, multi-mode optical fibers stand out as cost-effective and easy-to-handle tools, making them attractive for several tasks. In this context, we cast these fibers into random hardware projectors, transforming an input dataset into a higher dimensional speckled image set. The goal of our study is to demonstrate that using such randomized data for classification by training a single logistic regression layer improves accuracy compared to training on direct raw images. Interestingly, we found that the classification accuracy achieved is higher than that obtained with the standard transmission matrix model, a widely accepted tool for describing light transmission through disordered devices. We conjecture that the reason for such improved performance could be due to the fact that the hardware classifier operates in a flatter region of the loss landscape when trained on fiber data, which aligns with the current theory of deep neural networks. These findings suggest that the class of random projections operated by multi-mode fibers generalize better to previously unseen data, positioning them as promising tools for optically-assisted neural networks. With this study, in fact, we want to contribute to advancing the knowledge and practical utilization of these versatile instruments, which may play a significant role in shaping the future of neuromorphic machine learning.
format Preprint
id arxiv_https___arxiv_org_abs_2210_04745
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Low-power multi-mode fiber projector overcomes shallow neural networks classifiers
Ancora, Daniele
Negri, Matteo
Gianfrate, Antonio
Trypogeorgos, Dimitris
Dominici, Lorenzo
Sanvitto, Daniele
Ricci-Tersenghi, Federico
Leuzzi, Luca
Optics
Applied Physics
Data Analysis, Statistics and Probability
Machine Learning
In the domain of disordered photonics, the characterization of optically opaque materials for light manipulation and imaging is a primary aim. Among various complex devices, multi-mode optical fibers stand out as cost-effective and easy-to-handle tools, making them attractive for several tasks. In this context, we cast these fibers into random hardware projectors, transforming an input dataset into a higher dimensional speckled image set. The goal of our study is to demonstrate that using such randomized data for classification by training a single logistic regression layer improves accuracy compared to training on direct raw images. Interestingly, we found that the classification accuracy achieved is higher than that obtained with the standard transmission matrix model, a widely accepted tool for describing light transmission through disordered devices. We conjecture that the reason for such improved performance could be due to the fact that the hardware classifier operates in a flatter region of the loss landscape when trained on fiber data, which aligns with the current theory of deep neural networks. These findings suggest that the class of random projections operated by multi-mode fibers generalize better to previously unseen data, positioning them as promising tools for optically-assisted neural networks. With this study, in fact, we want to contribute to advancing the knowledge and practical utilization of these versatile instruments, which may play a significant role in shaping the future of neuromorphic machine learning.
title Low-power multi-mode fiber projector overcomes shallow neural networks classifiers
topic Optics
Applied Physics
Data Analysis, Statistics and Probability
Machine Learning
url https://arxiv.org/abs/2210.04745