Literature DB >> 31996818

Fully hardware-implemented memristor convolutional neural network.

Peng Yao1, Huaqiang Wu2,3, Bin Gao1,4, Jianshi Tang1,4, Qingtian Zhang1, Wenqiang Zhang1, J Joshua Yang5, He Qian1,4.   

Abstract

Memristor-enabled neuromorphic computing systems provide a fast and energy-efficient approach to training neural networks1-4. However, convolutional neural networks (CNNs)-one of the most important models for image recognition5-have not yet been fully hardware-implemented using memristor crossbars, which are cross-point arrays with a memristor device at each intersection. Moreover, achieving software-comparable results is highly challenging owing to the poor yield, large variation and other non-ideal characteristics of devices6-9. Here we report the fabrication of high-yield, high-performance and uniform memristor crossbar arrays for the implementation of CNNs, which integrate eight 2,048-cell memristor arrays to improve parallel-computing efficiency. In addition, we propose an effective hybrid-training method to adapt to device imperfections and improve the overall system performance. We built a five-layer memristor-based CNN to perform MNIST10 image recognition, and achieved a high accuracy of more than 96 per cent. In addition to parallel convolutions using different kernels with shared inputs, replication of multiple identical kernels in memristor arrays was demonstrated for processing different inputs in parallel. The memristor-based CNN neuromorphic system has an energy efficiency more than two orders of magnitude greater than that of state-of-the-art graphics-processing units, and is shown to be scalable to larger networks, such as residual neural networks. Our results are expected to enable a viable memristor-based non-von Neumann hardware solution for deep neural networks and edge computing.

Year:  2020        PMID: 31996818     DOI: 10.1038/s41586-020-1942-4

Source DB:  PubMed          Journal:  Nature        ISSN: 0028-0836            Impact factor:   49.962


  64 in total

Review 1.  Optical Computing: Status and Perspectives.

Authors:  Nikolay L Kazanskiy; Muhammad A Butt; Svetlana N Khonina
Journal:  Nanomaterials (Basel)       Date:  2022-06-24       Impact factor: 5.719

2.  Organismic Memristive Structures With Variable Functionality for Neuroelectronics.

Authors:  Natalia V Andreeva; Eugeny A Ryndin; Dmitriy S Mazing; Oleg Y Vilkov; Victor V Luchinin
Journal:  Front Neurosci       Date:  2022-06-14       Impact factor: 5.152

Review 3.  Toward Reflective Spiking Neural Networks Exploiting Memristive Devices.

Authors:  Valeri A Makarov; Sergey A Lobov; Sergey Shchanikov; Alexey Mikhaylov; Viktor B Kazantsev
Journal:  Front Comput Neurosci       Date:  2022-06-16       Impact factor: 3.387

4.  An Improved Convolutional Neural Network-Based Scene Image Recognition Method.

Authors:  Pinhe Wang; Jianzhong Qiao; Nannan Liu
Journal:  Comput Intell Neurosci       Date:  2022-06-29

Review 5.  Applications and Techniques for Fast Machine Learning in Science.

Authors:  Allison McCarn Deiana; Nhan Tran; Joshua Agar; Michaela Blott; Giuseppe Di Guglielmo; Javier Duarte; Philip Harris; Scott Hauck; Mia Liu; Mark S Neubauer; Jennifer Ngadiuba; Seda Ogrenci-Memik; Maurizio Pierini; Thea Aarrestad; Steffen Bähr; Jürgen Becker; Anne-Sophie Berthold; Richard J Bonventre; Tomás E Müller Bravo; Markus Diefenthaler; Zhen Dong; Nick Fritzsche; Amir Gholami; Ekaterina Govorkova; Dongning Guo; Kyle J Hazelwood; Christian Herwig; Babar Khan; Sehoon Kim; Thomas Klijnsma; Yaling Liu; Kin Ho Lo; Tri Nguyen; Gianantonio Pezzullo; Seyedramin Rasoulinezhad; Ryan A Rivera; Kate Scholberg; Justin Selig; Sougata Sen; Dmitri Strukov; William Tang; Savannah Thais; Kai Lukas Unger; Ricardo Vilalta; Belina von Krosigk; Shen Wang; Thomas K Warburton
Journal:  Front Big Data       Date:  2022-04-12

6.  Neuromorphic Binarized Polariton Networks.

Authors:  Rafał Mirek; Andrzej Opala; Paolo Comaron; Magdalena Furman; Mateusz Król; Krzysztof Tyszka; Bartłomiej Seredyński; Dario Ballarini; Daniele Sanvitto; Timothy C H Liew; Wojciech Pacuski; Jan Suffczyński; Jacek Szczytko; Michał Matuszewski; Barbara Piętka
Journal:  Nano Lett       Date:  2021-02-26       Impact factor: 11.189

7.  Implementing in-situ self-organizing maps with memristor crossbar arrays for data mining and optimization.

Authors:  Rui Wang; Tuo Shi; Xumeng Zhang; Jinsong Wei; Jian Lu; Jiaxue Zhu; Zuheng Wu; Qi Liu; Ming Liu
Journal:  Nat Commun       Date:  2022-04-28       Impact factor: 17.694

Review 8.  On the Thermal Models for Resistive Random Access Memory Circuit Simulation.

Authors:  Juan B Roldán; Gerardo González-Cordero; Rodrigo Picos; Enrique Miranda; Félix Palumbo; Francisco Jiménez-Molinos; Enrique Moreno; David Maldonado; Santiago B Baldomá; Mohamad Moner Al Chawa; Carol de Benito; Stavros G Stavrinides; Jordi Suñé; Leon O Chua
Journal:  Nanomaterials (Basel)       Date:  2021-05-11       Impact factor: 5.076

9.  Exploring Area-Dependent Pr0.7Ca0.3MnO3-Based Memristive Devices as Synapses in Spiking and Artificial Neural Networks.

Authors:  Alexander Gutsche; Sebastian Siegel; Jinchao Zhang; Sebastian Hambsch; Regina Dittmann
Journal:  Front Neurosci       Date:  2021-07-02       Impact factor: 4.677

10.  Avalanches and edge-of-chaos learning in neuromorphic nanowire networks.

Authors:  Joel Hochstetter; Ruomin Zhu; Alon Loeffler; Adrian Diaz-Alvarez; Tomonobu Nakayama; Zdenka Kuncic
Journal:  Nat Commun       Date:  2021-06-29       Impact factor: 14.919

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.