Literature DB >> 22287807

Rethinking reinforcement: allocation, induction, and contingency.

William M Baum1.   

Abstract

The concept of reinforcement is at least incomplete and almost certainly incorrect. An alternative way of organizing our understanding of behavior may be built around three concepts: allocation, induction, and correlation. Allocation is the measure of behavior and captures the centrality of choice: All behavior entails choice and consists of choice. Allocation changes as a result of induction and correlation. The term induction covers phenomena such as adjunctive, interim, and terminal behavior-behavior induced in a situation by occurrence of food or another Phylogenetically Important Event (PIE) in that situation. Induction resembles stimulus control in that no one-to-one relation exists between induced behavior and the inducing event. If one allowed that some stimulus control were the result of phylogeny, then induction and stimulus control would be identical, and a PIE would resemble a discriminative stimulus. Much evidence supports the idea that a PIE induces all PIE-related activities. Research also supports the idea that stimuli correlated with PIEs become PIE-related conditional inducers. Contingencies create correlations between "operant" activity (e.g., lever pressing) and PIEs (e.g., food). Once an activity has become PIE-related, the PIE induces it along with other PIE-related activities. Contingencies also constrain possible performances. These constraints specify feedback functions, which explain phenomena such as the higher response rates on ratio schedules in comparison with interval schedules. Allocations that include a lot of operant activity are "selected" only in the sense that they generate more frequent occurrence of the PIE within the constraints of the situation; contingency and induction do the "selecting."

Keywords:  Phylogenetically Important Event; allocation; contingency; correlation; inducer; inducing stimulus; induction; reinforcement; reinstatement

Mesh:

Year:  2012        PMID: 22287807      PMCID: PMC3266735          DOI: 10.1901/jeab.2012.97-101

Source DB:  PubMed          Journal:  J Exp Anal Behav        ISSN: 0022-5002            Impact factor:   2.468


  57 in total

1.  Molar versus as a paradigm clash.

Authors:  W M Baum
Journal:  J Exp Anal Behav       Date:  2001-05       Impact factor: 2.468

2.  Rules, culture, and fitness.

Authors:  W M Baum
Journal:  Behav Anal       Date:  1995

3.  Quantitative prediction and molar description of the environment.

Authors:  W M Baum
Journal:  Behav Anal       Date:  1989

4.  Diversity and substitutability of adjunctive activities under fixed-interval schedules of food reinforcement.

Authors:  T J Roper
Journal:  J Exp Anal Behav       Date:  1978-07       Impact factor: 2.468

5.  Auto-maintenance in the pigeon: sustained pecking despite contingent non-reinforcement.

Authors:  D R Williams; H Williams
Journal:  J Exp Anal Behav       Date:  1969-07       Impact factor: 2.468

6.  Do conditional reinforcers count?

Authors:  Michael Davison; William M Baum
Journal:  J Exp Anal Behav       Date:  2006-11       Impact factor: 2.468

7.  Dynamics of choice: a tutorial.

Authors:  William M Baum
Journal:  J Exp Anal Behav       Date:  2010-09       Impact factor: 2.468

8.  Contingent stimuli signal subsequent reinforcer ratios.

Authors:  Nathalie Boutros; Michael Davison; Douglas Elliffe
Journal:  J Exp Anal Behav       Date:  2011-07       Impact factor: 2.468

9.  Pavlovian conditioning. It's not what you think it is.

Authors:  R A Rescorla
Journal:  Am Psychol       Date:  1988-03

10.  Matching, undermatching, and overmatching in studies of choice.

Authors:  W M Baum
Journal:  J Exp Anal Behav       Date:  1979-09       Impact factor: 2.468

View more
  21 in total

1.  A derived transformation of emotional functions using self-reports, implicit association tests, and frontal alpha asymmetries.

Authors:  Micah Amd; Bryan Roche
Journal:  Learn Behav       Date:  2016-06       Impact factor: 1.986

2.  Stimulus control of actions and habits: A role for reinforcer predictability and attention in the development of habitual behavior.

Authors:  Eric A Thrailkill; Sydney Trask; Pedro Vidal; José A Alcalá; Mark E Bouton
Journal:  J Exp Psychol Anim Learn Cogn       Date:  2018-10       Impact factor: 2.478

3.  Reinforcement of schedule-induced drinking in rats by lick-contingent shortening of food delivery.

Authors:  Beatriz Álvarez; Javier Íbias; Ricardo Pellón
Journal:  Learn Behav       Date:  2016-12       Impact factor: 1.986

4.  Information: theory, brain, and behavior.

Authors:  Greg Jensen; Ryan D Ward; Peter D Balsam
Journal:  J Exp Anal Behav       Date:  2013-10-04       Impact factor: 2.468

5.  Effect of streptozotocin-induced diabetes on performance on a progressive ratio schedule.

Authors:  Lourdes Valencia-Torres; C M Bradshaw; Arturo Bouzas; Enrique Hong; Vladimir Orduña
Journal:  Psychopharmacology (Berl)       Date:  2014-01-09       Impact factor: 4.530

6.  Changing course: a reply.

Authors:  Stuart Vyse
Journal:  Behav Anal       Date:  2013

7.  What Counts as Behavior? The Molar Multiscale View.

Authors:  William M Baum
Journal:  Behav Anal       Date:  2013

8.  On Multiscaled and Unified.

Authors:  Raymond C Pitts
Journal:  Behav Anal       Date:  2013

9.  Generalizing from the Past, Choosing the Future.

Authors:  Sarah Cowie; Michael Davison
Journal:  Perspect Behav Sci       Date:  2020-06-11

10.  A bout analysis of operant response disruption.

Authors:  Ryan J Brackney; Timothy H C Cheung; Federico Sanabria
Journal:  Behav Processes       Date:  2017-04-19       Impact factor: 1.777

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.