Literature DB >> 25729361

Probabilistic inference in discrete spaces can be implemented into networks of LIF neurons.

Dimitri Probst1, Mihai A Petrovici1, Ilja Bytschok1, Johannes Bill2, Dejan Pecevski2, Johannes Schemmel1, Karlheinz Meier1.   

Abstract

The means by which cortical neural networks are able to efficiently solve inference problems remains an open question in computational neuroscience. Recently, abstract models of Bayesian computation in neural circuits have been proposed, but they lack a mechanistic interpretation at the single-cell level. In this article, we describe a complete theoretical framework for building networks of leaky integrate-and-fire neurons that can sample from arbitrary probability distributions over binary random variables. We test our framework for a model inference task based on a psychophysical phenomenon (the Knill-Kersten optical illusion) and further assess its performance when applied to randomly generated distributions. As the local computations performed by the network strongly depend on the interaction between neurons, we compare several types of couplings mediated by either single synapses or interneuron chains. Due to its robustness to substrate imperfections such as parameter noise and background noise correlations, our model is particularly interesting for implementation on novel, neuro-inspired computing architectures, which can thereby serve as a fast, low-power substrate for solving real-world inference problems.

Entities:  

Keywords:  Bayesian theory; MCMC; computational neural models; graphical models; neural coding; neuromorphic hardware; probabilistic models and methods; theoretical neuroscience

Year:  2015        PMID: 25729361      PMCID: PMC4325917          DOI: 10.3389/fncom.2015.00013

Source DB:  PubMed          Journal:  Front Comput Neurosci        ISSN: 1662-5188            Impact factor:   2.380


  21 in total

1.  Stable propagation of synchronous spiking in cortical neural networks.

Authors:  M Diesmann; M O Gewaltig; A Aertsen
Journal:  Nature       Date:  1999-12-02       Impact factor: 49.962

Review 2.  The high-conductance state of neocortical neurons in vivo.

Authors:  Alain Destexhe; Michael Rudolph; Denis Paré
Journal:  Nat Rev Neurosci       Date:  2003-09       Impact factor: 34.870

3.  Functional consequences of correlated excitatory and inhibitory conductances in cortical networks.

Authors:  Jens Kremkow; Laurent U Perrinet; Guillaume S Masson; Ad Aertsen
Journal:  J Comput Neurosci       Date:  2010-05-19       Impact factor: 1.621

4.  Adaptive exponential integrate-and-fire model as an effective description of neuronal activity.

Authors:  Romain Brette; Wulfram Gerstner
Journal:  J Neurophysiol       Date:  2005-07-13       Impact factor: 2.714

5.  Belief propagation in networks of spiking neurons.

Authors:  Andreas Steimer; Wolfgang Maass; Rodney Douglas
Journal:  Neural Comput       Date:  2009-09       Impact factor: 2.026

6.  The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability.

Authors:  M V Tsodyks; H Markram
Journal:  Proc Natl Acad Sci U S A       Date:  1997-01-21       Impact factor: 11.205

7.  Characterization and compensation of network-level anomalies in mixed-signal neuromorphic modeling platforms.

Authors:  Mihai A Petrovici; Bernhard Vogginger; Paul Müller; Oliver Breitwieser; Mikael Lundqvist; Lyle Muller; Matthias Ehrlich; Alain Destexhe; Anders Lansner; René Schüffny; Johannes Schemmel; Karlheinz Meier
Journal:  PLoS One       Date:  2014-10-10       Impact factor: 3.240

8.  Neural dynamics as sampling: a model for stochastic computation in recurrent networks of spiking neurons.

Authors:  Lars Buesing; Johannes Bill; Bernhard Nessler; Wolfgang Maass
Journal:  PLoS Comput Biol       Date:  2011-11-03       Impact factor: 4.475

9.  Probabilistic inference in general graphical models through sampling in stochastic networks of spiking neurons.

Authors:  Dejan Pecevski; Lars Buesing; Wolfgang Maass
Journal:  PLoS Comput Biol       Date:  2011-12-15       Impact factor: 4.475

10.  Ensembles of spiking neurons with noise support optimal probabilistic inference in a dynamically changing environment.

Authors:  Robert Legenstein; Wolfgang Maass
Journal:  PLoS Comput Biol       Date:  2014-10-23       Impact factor: 4.475

View more
  4 in total

1.  Cortical oscillations support sampling-based computations in spiking neural networks.

Authors:  Agnes Korcsak-Gorzo; Michael G Müller; Andreas Baumbach; Luziwei Leng; Oliver J Breitwieser; Sacha J van Albada; Walter Senn; Karlheinz Meier; Robert Legenstein; Mihai A Petrovici
Journal:  PLoS Comput Biol       Date:  2022-03-24       Impact factor: 4.475

2.  Stochastic Synapses Enable Efficient Brain-Inspired Learning Machines.

Authors:  Emre O Neftci; Bruno U Pedroni; Siddharth Joshi; Maruan Al-Shedivat; Gert Cauwenberghs
Journal:  Front Neurosci       Date:  2016-06-29       Impact factor: 4.677

3.  Deterministic networks for probabilistic computing.

Authors:  Jakob Jordan; Mihai A Petrovici; Oliver Breitwieser; Johannes Schemmel; Karlheinz Meier; Markus Diesmann; Tom Tetzlaff
Journal:  Sci Rep       Date:  2019-12-04       Impact factor: 4.379

4.  Accelerated Physical Emulation of Bayesian Inference in Spiking Neural Networks.

Authors:  Akos F Kungl; Sebastian Schmitt; Johann Klähn; Paul Müller; Andreas Baumbach; Dominik Dold; Alexander Kugele; Eric Müller; Christoph Koke; Mitja Kleider; Christian Mauch; Oliver Breitwieser; Luziwei Leng; Nico Gürtler; Maurice Güttler; Dan Husmann; Kai Husmann; Andreas Hartel; Vitali Karasenko; Andreas Grübl; Johannes Schemmel; Karlheinz Meier; Mihai A Petrovici
Journal:  Front Neurosci       Date:  2019-11-14       Impact factor: 4.677

  4 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.