Literature DB >> 25303102

Characterization and compensation of network-level anomalies in mixed-signal neuromorphic modeling platforms.

Mihai A Petrovici1, Bernhard Vogginger2, Paul Müller1, Oliver Breitwieser1, Mikael Lundqvist3, Lyle Muller4, Matthias Ehrlich2, Alain Destexhe4, Anders Lansner3, René Schüffny2, Johannes Schemmel1, Karlheinz Meier1.   

Abstract

Advancing the size and complexity of neural network models leads to an ever increasing demand for computational resources for their simulation. Neuromorphic devices offer a number of advantages over conventional computing architectures, such as high emulation speed or low power consumption, but this usually comes at the price of reduced configurability and precision. In this article, we investigate the consequences of several such factors that are common to neuromorphic devices, more specifically limited hardware resources, limited parameter configurability and parameter variations due to fixed-pattern noise and trial-to-trial variability. Our final aim is to provide an array of methods for coping with such inevitable distortion mechanisms. As a platform for testing our proposed strategies, we use an executable system specification (ESS) of the BrainScaleS neuromorphic system, which has been designed as a universal emulation back-end for neuroscientific modeling. We address the most essential limitations of this device in detail and study their effects on three prototypical benchmark network models within a well-defined, systematic workflow. For each network model, we start by defining quantifiable functionality measures by which we then assess the effects of typical hardware-specific distortion mechanisms, both in idealized software simulations and on the ESS. For those effects that cause unacceptable deviations from the original network dynamics, we suggest generic compensation mechanisms and demonstrate their effectiveness. Both the suggested workflow and the investigated compensation mechanisms are largely back-end independent and do not require additional hardware configurability beyond the one required to emulate the benchmark networks in the first place. We hereby provide a generic methodological environment for configurable neuromorphic devices that are targeted at emulating large-scale, functional neural networks.

Entities:  

Mesh:

Year:  2014        PMID: 25303102      PMCID: PMC4193761          DOI: 10.1371/journal.pone.0108590

Source DB:  PubMed          Journal:  PLoS One        ISSN: 1932-6203            Impact factor:   3.240


  62 in total

Review 1.  The high-conductance state of neocortical neurons in vivo.

Authors:  Alain Destexhe; Michael Rudolph; Denis Paré
Journal:  Nat Rev Neurosci       Date:  2003-09       Impact factor: 34.870

2.  Role of delays in shaping spatiotemporal dynamics of neuronal activity in large networks.

Authors:  Alex Roxin; Nicolas Brunel; David Hansel
Journal:  Phys Rev Lett       Date:  2005-06-16       Impact factor: 9.161

3.  Dynamically reconfigurable silicon array of spiking neurons with conductance-based synapses.

Authors:  R Jacob Vogelstein; Udayan Mallik; Joshua T Vogelstein; Gert Cauwenberghs
Journal:  IEEE Trans Neural Netw       Date:  2007-01

Review 4.  Neuronal computations with stochastic network states.

Authors:  Alain Destexhe; Diego Contreras
Journal:  Science       Date:  2006-10-06       Impact factor: 47.728

5.  A master equation formalism for macroscopic modeling of asynchronous irregular activity states.

Authors:  Sami El Boustani; Alain Destexhe
Journal:  Neural Comput       Date:  2009-01       Impact factor: 2.026

6.  Electrophysiological identification of horizontal synaptic connections in rat visual cortex in vitro.

Authors:  T Murakoshi; J Z Guo; T Ichinose
Journal:  Neurosci Lett       Date:  1993-12-12       Impact factor: 3.046

7.  Information processing with frequency-dependent synaptic connections.

Authors:  H Markram; A Gupta; A Uziel; Y Wang; M Tsodyks
Journal:  Neurobiol Learn Mem       Date:  1998 Jul-Sep       Impact factor: 2.877

8.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex.

Authors:  D J Amit; N Brunel
Journal:  Cereb Cortex       Date:  1997 Apr-May       Impact factor: 5.357

9.  Synaptic physiology of horizontal connections in the cat's visual cortex.

Authors:  J A Hirsch; C D Gilbert
Journal:  J Neurosci       Date:  1991-06       Impact factor: 6.167

10.  Neuromorphic VLSI Models of Selective Attention: From Single Chip Vision Sensors to Multi-chip Systems.

Authors:  Giacomo Indiveri
Journal:  Sensors (Basel)       Date:  2008-09-03       Impact factor: 3.576

View more
  9 in total

1.  Probabilistic inference in discrete spaces can be implemented into networks of LIF neurons.

Authors:  Dimitri Probst; Mihai A Petrovici; Ilja Bytschok; Johannes Bill; Dejan Pecevski; Johannes Schemmel; Karlheinz Meier
Journal:  Front Comput Neurosci       Date:  2015-02-12       Impact factor: 2.380

2.  Benchmarking Neuromorphic Hardware and Its Energy Expenditure.

Authors:  Christoph Ostrau; Christian Klarhorst; Michael Thies; Ulrich Rückert
Journal:  Front Neurosci       Date:  2022-06-02       Impact factor: 5.152

3.  A reconfigurable on-line learning spiking neuromorphic processor comprising 256 neurons and 128K synapses.

Authors:  Ning Qiao; Hesham Mostafa; Federico Corradi; Marc Osswald; Fabio Stefanini; Dora Sumislawska; Giacomo Indiveri
Journal:  Front Neurosci       Date:  2015-04-29       Impact factor: 4.677

4.  Binary Associative Memories as a Benchmark for Spiking Neuromorphic Hardware.

Authors:  Andreas Stöckel; Christoph Jenzen; Michael Thies; Ulrich Rückert
Journal:  Front Comput Neurosci       Date:  2017-08-22       Impact factor: 2.380

5.  Variational learning of quantum ground states on spiking neuromorphic hardware.

Authors:  Robert Klassert; Andreas Baumbach; Mihai A Petrovici; Martin Gärttner
Journal:  iScience       Date:  2022-07-05

6.  Spike-Based Bayesian-Hebbian Learning of Temporal Sequences.

Authors:  Philip J Tully; Henrik Lindén; Matthias H Hennig; Anders Lansner
Journal:  PLoS Comput Biol       Date:  2016-05-23       Impact factor: 4.475

7.  Network-driven design principles for neuromorphic systems.

Authors:  Johannes Partzsch; Rene Schüffny
Journal:  Front Neurosci       Date:  2015-10-20       Impact factor: 4.677

8.  Large-Scale Simulations of Plastic Neural Networks on Neuromorphic Hardware.

Authors:  James C Knight; Philip J Tully; Bernhard A Kaplan; Anders Lansner; Steve B Furber
Journal:  Front Neuroanat       Date:  2016-04-07       Impact factor: 3.856

9.  Accelerated Physical Emulation of Bayesian Inference in Spiking Neural Networks.

Authors:  Akos F Kungl; Sebastian Schmitt; Johann Klähn; Paul Müller; Andreas Baumbach; Dominik Dold; Alexander Kugele; Eric Müller; Christoph Koke; Mitja Kleider; Christian Mauch; Oliver Breitwieser; Luziwei Leng; Nico Gürtler; Maurice Güttler; Dan Husmann; Kai Husmann; Andreas Hartel; Vitali Karasenko; Andreas Grübl; Johannes Schemmel; Karlheinz Meier; Mihai A Petrovici
Journal:  Front Neurosci       Date:  2019-11-14       Impact factor: 4.677

  9 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.