Synergistic Development of Perovskite Memristors and Algorithms for Robust Analog Computing
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866915054597701632 |
|---|---|
| author | Ye, Nanyang Sun, Qiao Wang, Yifei Yang, Liujia Zhou, Jundong Wang, Lei Yang, Guang-Zhong Wang, Xinbing Zhou, Chenghu Ren, Wei Gu, Leilei Wu, Huaqiang Gu, Qinying |
| author_facet | Ye, Nanyang Sun, Qiao Wang, Yifei Yang, Liujia Zhou, Jundong Wang, Lei Yang, Guang-Zhong Wang, Xinbing Zhou, Chenghu Ren, Wei Gu, Leilei Wu, Huaqiang Gu, Qinying |
| contents | Analog computing using non-volatile memristors has emerged as a promising solution for energy-efficient deep learning. New materials, like perovskites-based memristors are recently attractive due to their cost-effectiveness, energy efficiency and flexibility. Yet, challenges in material diversity and immature fabrications require extensive experimentation for device development. Moreover, significant non-idealities in these memristors often impede them for computing. Here, we propose a synergistic methodology to concurrently optimize perovskite memristor fabrication and develop robust analog DNNs that effectively address the inherent non-idealities of these memristors. Employing Bayesian optimization (BO) with a focus on usability, we efficiently identify optimal materials and fabrication conditions for perovskite memristors. Meanwhile, we developed "BayesMulti", a DNN training strategy utilizing BO-guided noise injection to improve the resistance of analog DNNs to memristor imperfections. Our approach theoretically ensures that within a certain range of parameter perturbations due to memristor non-idealities, the prediction outcomes remain consistent. Our integrated approach enables use of analog computing in much deeper and wider networks, which significantly outperforms existing methods in diverse tasks like image classification, autonomous driving, species identification, and large vision-language models, achieving up to 100-fold improvements. We further validate our methodology on a 10$\times$10 optimized perovskite memristor crossbar, demonstrating high accuracy in a classification task and low energy consumption. This study offers a versatile solution for efficient optimization of various analog computing systems, encompassing both devices and algorithms. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_02779 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Synergistic Development of Perovskite Memristors and Algorithms for Robust Analog Computing Ye, Nanyang Sun, Qiao Wang, Yifei Yang, Liujia Zhou, Jundong Wang, Lei Yang, Guang-Zhong Wang, Xinbing Zhou, Chenghu Ren, Wei Gu, Leilei Wu, Huaqiang Gu, Qinying Machine Learning Artificial Intelligence Emerging Technologies Analog computing using non-volatile memristors has emerged as a promising solution for energy-efficient deep learning. New materials, like perovskites-based memristors are recently attractive due to their cost-effectiveness, energy efficiency and flexibility. Yet, challenges in material diversity and immature fabrications require extensive experimentation for device development. Moreover, significant non-idealities in these memristors often impede them for computing. Here, we propose a synergistic methodology to concurrently optimize perovskite memristor fabrication and develop robust analog DNNs that effectively address the inherent non-idealities of these memristors. Employing Bayesian optimization (BO) with a focus on usability, we efficiently identify optimal materials and fabrication conditions for perovskite memristors. Meanwhile, we developed "BayesMulti", a DNN training strategy utilizing BO-guided noise injection to improve the resistance of analog DNNs to memristor imperfections. Our approach theoretically ensures that within a certain range of parameter perturbations due to memristor non-idealities, the prediction outcomes remain consistent. Our integrated approach enables use of analog computing in much deeper and wider networks, which significantly outperforms existing methods in diverse tasks like image classification, autonomous driving, species identification, and large vision-language models, achieving up to 100-fold improvements. We further validate our methodology on a 10$\times$10 optimized perovskite memristor crossbar, demonstrating high accuracy in a classification task and low energy consumption. This study offers a versatile solution for efficient optimization of various analog computing systems, encompassing both devices and algorithms. |
| title | Synergistic Development of Perovskite Memristors and Algorithms for Robust Analog Computing |
| topic | Machine Learning Artificial Intelligence Emerging Technologies |
| url | https://arxiv.org/abs/2412.02779 |