Literature DB >> 20065349

Two-factor theory, the actor-critic model, and conditioned avoidance.

Tiago V Maia1.   

Abstract

Two-factor theory (Mowrer, 1947, 1951, 1956) remains one of the most influential theories of avoidance, but it is at odds with empirical findings that demonstrate sustained avoidance responding in situations in which the theory predicts that the response should extinguish. This article shows that the well-known actor-critic model seamlessly addresses the problems with two-factor theory, while simultaneously being consistent with the core ideas that underlie that theory. More specifically, the article shows that (1) the actor-critic model bears striking similarities to two-factor theory and explains all of the empirical phenomena that two-factor theory explains, in much the same way, and (2) there are subtle but important differences between the actor-critic model and two-factor theory, which result in the actor-critic model predicting the persistence of avoidance responses that is found empirically.

Mesh:

Year:  2010        PMID: 20065349     DOI: 10.3758/LB.38.1.50

Source DB:  PubMed          Journal:  Learn Behav        ISSN: 1543-4494            Impact factor:   1.986


  50 in total

1.  Response latency as a function of amount of reinforcement.

Authors:  W C STEBBINS
Journal:  J Exp Anal Behav       Date:  1962-07       Impact factor: 2.468

2.  Some properties of conditioned inhibition.

Authors:  H CHORAZYNA
Journal:  Acta Biol Exp (Warsz)       Date:  1962

3.  Two-factor learning theory reconsidered, with special reference to secondary reinforcement and the concept of habit.

Authors:  O H MOWRER
Journal:  Psychol Rev       Date:  1956-03       Impact factor: 8.934

4.  Two-factor learning theory: summary and comment.

Authors:  O H MOWRER
Journal:  Psychol Rev       Date:  1951-09       Impact factor: 8.934

Review 5.  A neural substrate of prediction and reward.

Authors:  W Schultz; P Dayan; P R Montague
Journal:  Science       Date:  1997-03-14       Impact factor: 47.728

6.  Extinction of avoidance behavior and the problem of residual fear.

Authors:  D C Riccio; R Silvestri
Journal:  Behav Res Ther       Date:  1973-02

7.  Species-specific behavior and acquisition of avoidance behavior in rats.

Authors:  N E Grossen; M J Kelley
Journal:  J Comp Physiol Psychol       Date:  1972-11

8.  Species-specific defense reactions and avoidance learning. An evaluative review.

Authors:  M Crawford; F A Masterson
Journal:  Pavlov J Biol Sci       Date:  1982 Oct-Dec

Review 9.  Reward, motivation, and reinforcement learning.

Authors:  Peter Dayan; Bernard W Balleine
Journal:  Neuron       Date:  2002-10-10       Impact factor: 17.173

10.  Silencing the critics: understanding the effects of cocaine sensitization on dorsolateral and ventral striatum in the context of an actor/critic model.

Authors:  Yuji Takahashi; Geoffrey Schoenbaum; Yael Niv
Journal:  Front Neurosci       Date:  2008-07-09       Impact factor: 4.677

View more
  45 in total

Review 1.  From reinforcement learning models to psychiatric and neurological disorders.

Authors:  Tiago V Maia; Michael J Frank
Journal:  Nat Neurosci       Date:  2011-02       Impact factor: 24.884

Review 2.  Opponency revisited: competition and cooperation between dopamine and serotonin.

Authors:  Y-Lan Boureau; Peter Dayan
Journal:  Neuropsychopharmacology       Date:  2010-09-29       Impact factor: 7.853

Review 3.  Ventral striatum: a critical look at models of learning and evaluation.

Authors:  Matthijs A A van der Meer; A David Redish
Journal:  Curr Opin Neurobiol       Date:  2011-03-21       Impact factor: 6.627

4.  Negative symptoms and the failure to represent the expected reward value of actions: behavioral and computational modeling evidence.

Authors:  James M Gold; James A Waltz; Tatyana M Matveeva; Zuzana Kasanova; Gregory P Strauss; Ellen S Herbener; Anne G E Collins; Michael J Frank
Journal:  Arch Gen Psychiatry       Date:  2012-02

Review 5.  Navigating complex decision spaces: Problems and paradigms in sequential choice.

Authors:  Matthew M Walsh; John R Anderson
Journal:  Psychol Bull       Date:  2013-07-08       Impact factor: 17.737

6.  Information: theory, brain, and behavior.

Authors:  Greg Jensen; Ryan D Ward; Peter D Balsam
Journal:  J Exp Anal Behav       Date:  2013-10-04       Impact factor: 2.468

7.  Roles of D1-like dopamine receptors in the nucleus accumbens and dorsolateral striatum in conditioned avoidance responses.

Authors:  Evellyn Claudia Wietzikoski; Suelen Lúcio Boschen; Edmar Miyoshi; Mariza Bortolanza; Lucélia Mendes Dos Santos; Michael Frank; Marcus Lira Brandão; Philip Winn; Claudio Da Cunha
Journal:  Psychopharmacology (Berl)       Date:  2011-07-01       Impact factor: 4.530

Review 8.  A role for phasic dopamine release within the nucleus accumbens in encoding aversion: a review of the neurochemical literature.

Authors:  Jennifer M Wenzel; Noah A Rauscher; Joseph F Cheer; Erik B Oleson
Journal:  ACS Chem Neurosci       Date:  2014-12-24       Impact factor: 4.418

9.  Avoidance and escape: Defensive reactivity and trait anxiety.

Authors:  Christopher T Sege; Margaret M Bradley; Peter J Lang
Journal:  Behav Res Ther       Date:  2018-03-08

10.  Dopaminergic prediction errors persevere in the nucleus accumbens core during negative reinforcement.

Authors:  Nick G Hollon; Marta E Soden; Matthew J Wanat
Journal:  J Neurosci       Date:  2013-02-20       Impact factor: 6.167

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.