Literature DB >> 32503982

Control of criticality and computation in spiking neuromorphic networks with plasticity.

Benjamin Cramer1, David Stöckel2, Markus Kreft2, Michael Wibral3, Johannes Schemmel2, Karlheinz Meier2, Viola Priesemann4,5,6.   

Abstract

The critical state is assumed to be optimal for any computation in recurrent neural networks, because criticality maximizes a number of abstract computational properties. We challenge this assumption by evaluating the performance of a spiking recurrent neural network on a set of tasks of varying complexity at - and away from critical network dynamics. To that end, we developed a plastic spiking network on a neuromorphic chip. We show that the distance to criticality can be easily adapted by changing the input strength, and then demonstrate a clear relation between criticality, task-performance and information-theoretic fingerprint. Whereas the information-theoretic measures all show that network capacity is maximal at criticality, only the complex tasks profit from criticality, whereas simple tasks suffer. Thereby, we challenge the general assumption that criticality would be beneficial for any task, and provide instead an understanding of how the collective network state should be tuned to task requirement.

Entities:  

Year:  2020        PMID: 32503982      PMCID: PMC7275091          DOI: 10.1038/s41467-020-16548-3

Source DB:  PubMed          Journal:  Nat Commun        ISSN: 2041-1723            Impact factor:   14.919


  30 in total

1.  Real-time computation at the edge of chaos in recurrent neural networks.

Authors:  Nils Bertschinger; Thomas Natschläger
Journal:  Neural Comput       Date:  2004-07       Impact factor: 2.026

2.  Information processing in echo state networks at the edge of chaos.

Authors:  Joschka Boedecker; Oliver Obst; Joseph T Lizier; N Michael Mayer; Minoru Asada
Journal:  Theory Biosci       Date:  2011-12-07       Impact factor: 1.919

Review 3.  The functional benefits of criticality in the cortex.

Authors:  Woodrow L Shew; Dietmar Plenz
Journal:  Neuroscientist       Date:  2012-05-24       Impact factor: 7.519

4.  Edge of chaos and prediction of computational performance for neural circuit models.

Authors:  Robert Legenstein; Wolfgang Maass
Journal:  Neural Netw       Date:  2007-05-03

5.  Information flow in a kinetic Ising model peaks in the disordered phase.

Authors:  Lionel Barnett; Joseph T Lizier; Michael Harré; Anil K Seth; Terry Bossomaier
Journal:  Phys Rev Lett       Date:  2013-10-24       Impact factor: 9.161

6.  Self-organized criticality in developing neuronal networks.

Authors:  Christian Tetzlaff; Samora Okujeni; Ulrich Egert; Florentin Wörgötter; Markus Butz
Journal:  PLoS Comput Biol       Date:  2010-12-02       Impact factor: 4.475

7.  Synaptic plasticity enables adaptive self-tuning critical networks.

Authors:  Nigel Stepp; Dietmar Plenz; Narayan Srinivasa
Journal:  PLoS Comput Biol       Date:  2015-01-15       Impact factor: 4.475

8.  Criticality meets learning: Criticality signatures in a self-organizing recurrent neural network.

Authors:  Bruno Del Papa; Viola Priesemann; Jochen Triesch
Journal:  PLoS One       Date:  2017-05-26       Impact factor: 3.240

9.  Thermodynamics and signatures of criticality in a network of neurons.

Authors:  Gašper Tkačik; Thierry Mora; Olivier Marre; Dario Amodei; Stephanie E Palmer; Michael J Berry; William Bialek
Journal:  Proc Natl Acad Sci U S A       Date:  2015-09-01       Impact factor: 11.205

10.  Operating in a Reverberating Regime Enables Rapid Tuning of Network States to Task Requirements.

Authors:  Jens Wilting; Jonas Dehning; Joao Pinheiro Neto; Lucas Rudelt; Michael Wibral; Johannes Zierenberg; Viola Priesemann
Journal:  Front Syst Neurosci       Date:  2018-11-06
View more
  14 in total

Review 1.  Replay, the default mode network and the cascaded memory systems model.

Authors:  Karola Kaefer; Federico Stella; Bruce L McNaughton; Francesco P Battaglia
Journal:  Nat Rev Neurosci       Date:  2022-08-15       Impact factor: 38.755

2.  α-Synuclein Impacts on Intrinsic Neuronal Network Activity Through Reduced Levels of Cyclic AMP and Diminished Numbers of Active Presynaptic Terminals.

Authors:  Kristian Leite; Pretty Garg; F Paul Spitzner; Sofia Guerin Darvas; Mathias Bähr; Viola Priesemann; Sebastian Kügler
Journal:  Front Mol Neurosci       Date:  2022-05-03       Impact factor: 6.261

3.  Subcritical escape waves in schooling fish.

Authors:  Winnie Poel; Bryan C Daniels; Matthew M G Sosna; Colin R Twomey; Simon P Leblanc; Iain D Couzin; Pawel Romanczuk
Journal:  Sci Adv       Date:  2022-06-22       Impact factor: 14.957

4.  Early lock-in of structured and specialised information flows during neural development.

Authors:  David P Shorten; Viola Priesemann; Michael Wibral; Joseph T Lizier
Journal:  Elife       Date:  2022-03-14       Impact factor: 8.713

5.  Hopf Bifurcation in Mean Field Explains Critical Avalanches in Excitation-Inhibition Balanced Neuronal Networks: A Mechanism for Multiscale Variability.

Authors:  Junhao Liang; Tianshou Zhou; Changsong Zhou
Journal:  Front Syst Neurosci       Date:  2020-11-26

6.  Avalanche criticality during ferroelectric/ferroelastic switching.

Authors:  Blai Casals; Guillaume F Nataf; Ekhard K H Salje
Journal:  Nat Commun       Date:  2021-01-12       Impact factor: 14.919

7.  Segregation, integration, and balance of large-scale resting brain networks configure different cognitive abilities.

Authors:  Rong Wang; Mianxin Liu; Xinhong Cheng; Ying Wu; Andrea Hildebrandt; Changsong Zhou
Journal:  Proc Natl Acad Sci U S A       Date:  2021-06-08       Impact factor: 11.205

8.  Avalanches and edge-of-chaos learning in neuromorphic nanowire networks.

Authors:  Joel Hochstetter; Ruomin Zhu; Alon Loeffler; Adrian Diaz-Alvarez; Tomonobu Nakayama; Zdenka Kuncic
Journal:  Nat Commun       Date:  2021-06-29       Impact factor: 14.919

Review 9.  Information Theory for Agents in Artificial Intelligence, Psychology, and Economics.

Authors:  Michael S Harré
Journal:  Entropy (Basel)       Date:  2021-03-06       Impact factor: 2.524

10.  Information dynamics in neuromorphic nanowire networks.

Authors:  Ruomin Zhu; Joel Hochstetter; Alon Loeffler; Adrian Diaz-Alvarez; Tomonobu Nakayama; Joseph T Lizier; Zdenka Kuncic
Journal:  Sci Rep       Date:  2021-06-22       Impact factor: 4.379

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.