Literature DB >> 23891930

The error in total error reduction.

James E Witnauer1, Gonzalo P Urcelay2, Ralph R Miller3.   

Abstract

Most models of human and animal learning assume that learning is proportional to the discrepancy between a delivered outcome and the outcome predicted by all cues present during that trial (i.e., total error across a stimulus compound). This total error reduction (TER) view has been implemented in connectionist and artificial neural network models to describe the conditions under which weights between units change. Electrophysiological work has revealed that the activity of dopamine neurons is correlated with the total error signal in models of reward learning. Similar neural mechanisms presumably support fear conditioning, human contingency learning, and other types of learning. Using a computational modeling approach, we compared several TER models of associative learning to an alternative model that rejects the TER assumption in favor of local error reduction (LER), which assumes that learning about each cue is proportional to the discrepancy between the delivered outcome and the outcome predicted by that specific cue on that trial. The LER model provided a better fit to the reviewed data than the TER models. Given the superiority of the LER model with the present data sets, acceptance of TER should be tempered.
Copyright © 2013 Elsevier Inc. All rights reserved.

Entities:  

Keywords:  Associative learning; Conditioned inhibition; Cue competition; Local error reduction; Pavlovian conditioning; Total error reduction; Within-compound associations

Mesh:

Year:  2013        PMID: 23891930      PMCID: PMC3902048          DOI: 10.1016/j.nlm.2013.07.018

Source DB:  PubMed          Journal:  Neurobiol Learn Mem        ISSN: 1074-7427            Impact factor:   2.877


  58 in total

1.  Stimulus representation in SOP: I. Theoretical rationalization and some implications.

Authors:  Susan E. Brandon; Edgar H. Vogel; Allan R. Wagner
Journal:  Behav Processes       Date:  2003-04-28       Impact factor: 1.777

2.  ALCOVE: an exemplar-based connectionist model of category learning.

Authors:  J K Kruschke
Journal:  Psychol Rev       Date:  1992-01       Impact factor: 8.934

3.  The role of prefrontal cortex in predictive fear learning.

Authors:  Teri M Furlong; Sindy Cole; Adam S Hamlin; Gavan P McNally
Journal:  Behav Neurosci       Date:  2010-10       Impact factor: 1.912

4.  Addiction as a computational process gone awry.

Authors:  A David Redish
Journal:  Science       Date:  2004-12-10       Impact factor: 47.728

5.  Temporal-difference prediction errors and Pavlovian fear conditioning: role of NMDA and opioid receptors.

Authors:  Sindy Cole; Gavan P McNally
Journal:  Behav Neurosci       Date:  2007-10       Impact factor: 1.912

Review 6.  Determinants of cue interactions.

Authors:  Daniel S Wheeler; Ralph R Miller
Journal:  Behav Processes       Date:  2008-02-08       Impact factor: 1.777

7.  Overshadowing and latent inhibition counteract each other: support for the comparator hypothesis.

Authors:  A P Blaisdell; A S Bristol; L M Gunther; R R Miller
Journal:  J Exp Psychol Anim Behav Process       Date:  1998-07

8.  The criterion-calibration model of cue interaction in contingency judgments.

Authors:  Samuel D Hannah; Lorraine G Allan
Journal:  Learn Behav       Date:  2011-05       Impact factor: 1.986

Review 9.  A neural substrate of prediction and reward.

Authors:  W Schultz; P Dayan; P R Montague
Journal:  Science       Date:  1997-03-14       Impact factor: 47.728

10.  Surprise and change: variations in the strength of present and absent cues in causal learning.

Authors:  Edward A Wasserman; Leyre Castro
Journal:  Learn Behav       Date:  2005-05       Impact factor: 1.986

View more
  4 in total

Review 1.  The functions of contexts in associative learning.

Authors:  Gonzalo P Urcelay; Ralph R Miller
Journal:  Behav Processes       Date:  2014-03-11       Impact factor: 1.777

Review 2.  Methods of comparing associative models and an application to retrospective revaluation.

Authors:  James E Witnauer; Ryan Hutchings; Ralph R Miller
Journal:  Behav Processes       Date:  2017-08-19       Impact factor: 1.777

3.  Agency rescues competition for credit assignment among predictive cues from adverse learning conditions.

Authors:  Mihwa Kang; Ingrid Reverte; Stephen Volz; Keith Kaufman; Salvatore Fevola; Anna Matarazzo; Fahd H Alhazmi; Inmaculada Marquez; Mihaela D Iordanova; Guillem R Esber
Journal:  Sci Rep       Date:  2021-08-10       Impact factor: 4.996

Review 4.  Retrospective revaluation: The phenomenon and its theoretical implications.

Authors:  Ralph R Miller; James E Witnauer
Journal:  Behav Processes       Date:  2015-09-03       Impact factor: 1.777

  4 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.