Literature DB >> 31588411

Prediction and control of operant behavior: What you see is not all there is.

Mark E Bouton1, Bernard W Balleine2.   

Abstract

Prediction and control of operant behavior are major goals of behavior analysis. We suggest that achieving these goals can benefit from doing more than identifying the three-term contingency between the behavior, its setting stimulus, and its consequences. Basic research now underscores the idea that prediction and control require consideration of the behavior's history. As one example, if an operant is a goal-directed action, it is controlled by the current value of the reinforcer, as illustrated by the so-called reinforcer devaluation effect. In contrast, if the behavior is a habit, it occurs automatically, without regard to the reinforcer's value, as illustrated by its insensitivity to the reinforcer devaluation effect. History variables that distinguish actions and habits include the extent of their prior practice and their schedule of reinforcement. Other operants can appear to have very low or zero strength. However, if the behavior has reached that level through extinction or punishment, it may precipitously increase in strength by changing the context, allowing time to pass, presenting the reinforcer contingently or noncontingently, or extinguishing an alternative behavior. Behaviors that are not suppressed by extinction or punishment are not affected the same way. When predicting the strength of an operant behavior, what you see is not all there is. The behavior's history counts.

Entities:  

Keywords:  action; behavioral history; behavioral inhibition; extinction; habit; punishment

Year:  2019        PMID: 31588411      PMCID: PMC6777851          DOI: 10.1037/bar0000108

Source DB:  PubMed          Journal:  Behav Anal (Wash D C)        ISSN: 2372-9414


  51 in total

1.  Reinstatement of punishment-suppressed opioid self-administration in rats: an alternative model of relapse to drug abuse.

Authors:  Leigh V Panlilio; Eric B Thorndike; Charles W Schindler
Journal:  Psychopharmacology (Berl)       Date:  2002-08-09       Impact factor: 4.530

2.  The role of the reinforcer as a stimulus.

Authors:  R L REID
Journal:  Br J Psychol       Date:  1958-08

3.  The control of instrumental action following outcome devaluation in young children aged between 1 and 4 years.

Authors:  U M H Klossek; J Russell; A Dickinson
Journal:  J Exp Psychol Gen       Date:  2008-02

4.  A model of resurgence based on behavioral momentum theory.

Authors:  Timothy A Shahan; Mary M Sweeney
Journal:  J Exp Anal Behav       Date:  2011-01       Impact factor: 2.468

5.  Pulling habits out of rats: adenosine 2A receptor antagonism in dorsomedial striatum rescues meth-amphetamine-induced deficits in goal-directed action.

Authors:  Teri M Furlong; Alva S A Supit; Laura H Corbit; Simon Killcross; Bernard W Balleine
Journal:  Addict Biol       Date:  2015-10-30       Impact factor: 4.280

Review 6.  Resurgence as Choice.

Authors:  Timothy A Shahan; Andrew R Craig
Journal:  Behav Processes       Date:  2016-10-26       Impact factor: 1.777

7.  Mechanisms of renewal after the extinction of instrumental behavior.

Authors:  Travis P Todd
Journal:  J Exp Psychol Anim Behav Process       Date:  2013-04-29

8.  Renewal after the punishment of free operant behavior.

Authors:  Mark E Bouton; Scott T Schepers
Journal:  J Exp Psychol Anim Learn Cogn       Date:  2014-12-01       Impact factor: 2.478

9.  Mechanisms of renewal after the extinction of discriminated operant behavior.

Authors:  Travis P Todd; Drina Vurbic; Mark E Bouton
Journal:  J Exp Psychol Anim Learn Cogn       Date:  2014-04-07       Impact factor: 2.478

10.  Impairments in goal-directed actions predict treatment response to cognitive-behavioral therapy in social anxiety disorder.

Authors:  Gail A Alvares; Bernard W Balleine; Adam J Guastella
Journal:  PLoS One       Date:  2014-04-11       Impact factor: 3.240

View more
  3 in total

1.  Relapse after incentivized choice treatment in humans: A laboratory model for studying behavior change.

Authors:  Eric A Thrailkill; José A Alcalá
Journal:  Exp Clin Psychopharmacol       Date:  2021-01-28       Impact factor: 3.157

2.  A Push For Examining Subjective Experience in Value-Based Decision-Making.

Authors:  Drew C Schreiner; Ege A Yalcinbas; Christina M Gremel
Journal:  Curr Opin Behav Sci       Date:  2021-04-15

3.  Information normally considered task-irrelevant drives decision-making and affects premotor circuit recruitment.

Authors:  Drew C Schreiner; Christian Cazares; Rafael Renteria; Christina M Gremel
Journal:  Nat Commun       Date:  2022-04-19       Impact factor: 17.694

  3 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.