Literature DB >> 2004134

Variable threshold as a model for selective attention, (de)sensitization, and anesthesia in associative neural networks.

L Wang1, J Ross.   

Abstract

We study the influence of a variable neuronal threshold on fixed points and convergence rates of an associative neural network in the presence of noise. We allow a random distribution in the activity levels of the patterns stored, and a modification to the standard Hebbian learning rule is proposed for this purpose. There is a threshold at which the retrieval ability, including the average final overlap and the convergence rate, is optimized for patterns with a particular activity level at a given noise level. This type of selective attention to one class of patterns with a certain activity level may be obtained at the cost of reducing the retrieval ability of the network for patterns with different activity levels. The effects of a constant threshold independent of noise, time, and pattern are discussed. For high-(low-) activity patterns, the average final overlap is shown to be increased at high noise levels and decreased at low noise levels by a negative (positive) constant threshold, whereas a positive (negative) threshold always reduces the final average overlap. When the magnitude of the constant threshold exceeds a critical value, there is no retrieval. Rates of convergence towards the stored pattern with negative (positive) thresholds are greater than those with positive (negative) thresholds. These results are related to (de)sensitization and anesthesia. For certain threshold values and patterns with certain activity levels, hysteresis appears in the plot of the average final overlap versus the noise level, even for first order interactions. We make the analogy between the pattern-dependent neuronal threshold proposed in the present paper and the "task-related" modulation in neuronal excitability determined by cognitive factors, such as the attentional state of a higher animal. A constant threshold is associated with overall changes in neuronal excitability caused, e.g., by various drugs and physical injuries. Neurophysiological evidence of a dynamically variable neuronal threshold, such as accommodation and potentiation, is presented.

Mesh:

Year:  1991        PMID: 2004134     DOI: 10.1007/bf00201984

Source DB:  PubMed          Journal:  Biol Cybern        ISSN: 0340-1200            Impact factor:   2.086


  17 in total

1.  Interactions of neural networks: models for distraction and concentration.

Authors:  L P Wang; J Ross
Journal:  Proc Natl Acad Sci U S A       Date:  1990-09       Impact factor: 11.205

2.  Synchronous neural networks of nonlinear threshold elements with hysteresis.

Authors:  L Wang; J Ross
Journal:  Proc Natl Acad Sci U S A       Date:  1990-02       Impact factor: 11.205

3.  Spin-glass models of neural networks.

Authors: 
Journal:  Phys Rev A Gen Phys       Date:  1985-08

4.  Information storage in neural networks with low levels of activity.

Authors: 
Journal:  Phys Rev A Gen Phys       Date:  1987-03-01

5.  Neural networks with hierarchically correlated patterns.

Authors: 
Journal:  Phys Rev A Gen Phys       Date:  1988-01-15

6.  Associative memory with high information content.

Authors: 
Journal:  Phys Rev A Gen Phys       Date:  1989-03-01

7.  A logical calculus of the ideas immanent in nervous activity. 1943.

Authors:  W S McCulloch; W Pitts
Journal:  Bull Math Biol       Date:  1990       Impact factor: 1.758

8.  The recent excitement about neural networks.

Authors:  F Crick
Journal:  Nature       Date:  1989-01-12       Impact factor: 49.962

9.  Neural networks and physical systems with emergent collective computational abilities.

Authors:  J J Hopfield
Journal:  Proc Natl Acad Sci U S A       Date:  1982-04       Impact factor: 11.205

10.  Neurons with graded response have collective computational properties like those of two-state neurons.

Authors:  J J Hopfield
Journal:  Proc Natl Acad Sci U S A       Date:  1984-05       Impact factor: 11.205

View more
  1 in total

1.  Nonassociative learning as gated neural integrator and differentiator in stimulus-response pathways.

Authors:  Chi-Sang Poon; Daniel L Young
Journal:  Behav Brain Funct       Date:  2006-08-08       Impact factor: 3.759

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.