Literature DB >> 27651489

Convolutional networks for fast, energy-efficient neuromorphic computing.

Steven K Esser1, Paul A Merolla2, John V Arthur2, Andrew S Cassidy2, Rathinakumar Appuswamy2, Alexander Andreopoulos2, David J Berg2, Jeffrey L McKinstry2, Timothy Melano2, Davis R Barch2, Carmelo di Nolfo2, Pallab Datta2, Arnon Amir2, Brian Taba2, Myron D Flickner2, Dharmendra S Modha2.   

Abstract

Deep networks are now able to achieve human-level performance on a broad spectrum of recognition tasks. Independently, neuromorphic computing has now demonstrated unprecedented energy-efficiency through a new chip architecture based on spiking neurons, low precision synapses, and a scalable communication network. Here, we demonstrate that neuromorphic computing, despite its novel architectural primitives, can implement deep convolution networks that (i) approach state-of-the-art classification accuracy across eight standard datasets encompassing vision and speech, (ii) perform inference while preserving the hardware's underlying energy-efficiency and high throughput, running on the aforementioned datasets at between 1,200 and 2,600 frames/s and using between 25 and 275 mW (effectively >6,000 frames/s per Watt), and (iii) can be specified and trained using backpropagation with the same ease-of-use as contemporary deep learning. This approach allows the algorithmic power of deep learning to be merged with the efficiency of neuromorphic processors, bringing the promise of embedded, intelligent, brain-inspired computing one step closer.

Entities:  

Keywords:  TrueNorth; convolutional network; neural network; neuromorphic

Year:  2016        PMID: 27651489      PMCID: PMC5068316          DOI: 10.1073/pnas.1604850113

Source DB:  PubMed          Journal:  Proc Natl Acad Sci U S A        ISSN: 0027-8424            Impact factor:   11.205


  10 in total

1.  Multi-column deep neural network for traffic sign classification.

Authors:  Dan Cireşan; Ueli Meier; Jonathan Masci; Jürgen Schmidhuber
Journal:  Neural Netw       Date:  2012-02-14

Review 2.  Deep learning.

Authors:  Yann LeCun; Yoshua Bengio; Geoffrey Hinton
Journal:  Nature       Date:  2015-05-28       Impact factor: 49.962

3.  Artificial brains. A million spiking-neuron integrated circuit with a scalable communication network and interface.

Authors:  Paul A Merolla; John V Arthur; Rodrigo Alvarez-Icaza; Andrew S Cassidy; Jun Sawada; Filipp Akopyan; Bryan L Jackson; Nabil Imam; Chen Guo; Yutaka Nakamura; Bernard Brezzo; Ivan Vo; Steven K Esser; Rathinakumar Appuswamy; Brian Taba; Arnon Amir; Myron D Flickner; William P Risk; Rajit Manohar; Dharmendra S Modha
Journal:  Science       Date:  2014-08-07       Impact factor: 47.728

4.  An event-based neural network architecture with an asynchronous programmable synaptic memory.

Authors:  Saber Moradi; Giacomo Indiveri
Journal:  IEEE Trans Biomed Circuits Syst       Date:  2014-02       Impact factor: 3.833

5.  Man vs. computer: benchmarking machine learning algorithms for traffic sign recognition.

Authors:  J Stallkamp; M Schlipsing; J Salmen; C Igel
Journal:  Neural Netw       Date:  2012-02-20

6.  Neocognitron: a self organizing neural network model for a mechanism of pattern recognition unaffected by shift in position.

Authors:  K Fukushima
Journal:  Biol Cybern       Date:  1980       Impact factor: 2.086

7.  The "independent components" of natural scenes are edge filters.

Authors:  A J Bell; T J Sejnowski
Journal:  Vision Res       Date:  1997-12       Impact factor: 1.886

8.  Six networks on a universal neuromorphic computing substrate.

Authors:  Thomas Pfeil; Andreas Grübl; Sebastian Jeltsch; Eric Müller; Paul Müller; Mihai A Petrovici; Michael Schmuker; Daniel Brüderle; Johannes Schemmel; Karlheinz Meier
Journal:  Front Neurosci       Date:  2013-02-18       Impact factor: 4.677

9.  Robustness of spiking Deep Belief Networks to noise and reduced bit precision of neuro-inspired hardware platforms.

Authors:  Evangelos Stromatias; Daniel Neil; Michael Pfeiffer; Francesco Galluppi; Steve B Furber; Shih-Chii Liu
Journal:  Front Neurosci       Date:  2015-07-09       Impact factor: 4.677

10.  Nanoconnectomic upper bound on the variability of synaptic plasticity.

Authors:  Thomas M Bartol; Cailey Bromer; Justin Kinney; Michael A Chirillo; Jennifer N Bourne; Kristen M Harris; Terrence J Sejnowski
Journal:  Elife       Date:  2015-11-30       Impact factor: 8.140

  10 in total
  54 in total

Review 1.  Spine dynamics in the brain, mental disorders and artificial neural networks.

Authors:  Haruo Kasai; Noam E Ziv; Hitoshi Okazaki; Sho Yagishita; Taro Toyoizumi
Journal:  Nat Rev Neurosci       Date:  2021-05-28       Impact factor: 34.870

2.  Energy-efficient neural network chips approach human recognition capabilities.

Authors:  Wolfgang Maass
Journal:  Proc Natl Acad Sci U S A       Date:  2016-10-04       Impact factor: 11.205

3.  New challenge for bionics--brain-inspired computing.

Authors:  Shan Yu
Journal:  Zool Res       Date:  2016-09-18

Review 4.  Toward Reflective Spiking Neural Networks Exploiting Memristive Devices.

Authors:  Valeri A Makarov; Sergey A Lobov; Sergey Shchanikov; Alexey Mikhaylov; Viktor B Kazantsev
Journal:  Front Comput Neurosci       Date:  2022-06-16       Impact factor: 3.387

5.  Intelligent Real-Time Face-Mask Detection System with Hardware Acceleration for COVID-19 Mitigation.

Authors:  Peter Sertic; Ayman Alahmar; Thangarajah Akilan; Marko Javorac; Yash Gupta
Journal:  Healthcare (Basel)       Date:  2022-05-09

6.  Training Deep Spiking Neural Networks Using Backpropagation.

Authors:  Jun Haeng Lee; Tobi Delbruck; Michael Pfeiffer
Journal:  Front Neurosci       Date:  2016-11-08       Impact factor: 4.677

7.  Implementing Signature Neural Networks with Spiking Neurons.

Authors:  José Luis Carrillo-Medina; Roberto Latorre
Journal:  Front Comput Neurosci       Date:  2016-12-20       Impact factor: 2.380

8.  Exploring Optimized Spiking Neural Network Architectures for Classification Tasks on Embedded Platforms.

Authors:  Tehreem Syed; Vijay Kakani; Xuenan Cui; Hakil Kim
Journal:  Sensors (Basel)       Date:  2021-05-07       Impact factor: 3.576

9.  Event-based backpropagation can compute exact gradients for spiking neural networks.

Authors:  Timo C Wunderlich; Christian Pehle
Journal:  Sci Rep       Date:  2021-06-18       Impact factor: 4.379

Review 10.  Deep Artificial Neural Networks and Neuromorphic Chips for Big Data Analysis: Pharmaceutical and Bioinformatics Applications.

Authors:  Lucas Antón Pastur-Romay; Francisco Cedrón; Alejandro Pazos; Ana Belén Porto-Pazos
Journal:  Int J Mol Sci       Date:  2016-08-11       Impact factor: 5.923

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.