Literature DB >> 22487044

Instrumental vigour in punishment and reward.

Peter Dayan1.   

Abstract

Recent notions about the vigour of responding in operant conditioning suggest that the long-run average rate of reward should control the alacrity of action in cases in which the actual cost of speed is balanced against the opportunity cost of sloth. The average reward rate is suggested as being reported by tonic activity in the dopamine system and thereby influencing all actions, including ones that do not themselves lead directly to the rewards. This idea is syntactically problematical for the case of punishment. Here, we broaden the scope of the original suggestion, providing a two-factor analysis of obviated punishment in a variety of operant circumstances. We also consider the effects of stochastically successful actions, which turn out to differ rather markedly between appetitive and aversive cases. Finally, we study how to fit these ideas into nascent treatments that extend concepts of opponency between dopamine and serotonin from valence to invigoration.
© 2012 The Author. European Journal of Neuroscience © 2012 Federation of European Neuroscience Societies and Blackwell Publishing Ltd.

Entities:  

Mesh:

Year:  2012        PMID: 22487044     DOI: 10.1111/j.1460-9568.2012.08026.x

Source DB:  PubMed          Journal:  Eur J Neurosci        ISSN: 0953-816X            Impact factor:   3.386


  35 in total

Review 1.  Navigating complex decision spaces: Problems and paradigms in sequential choice.

Authors:  Matthew M Walsh; John R Anderson
Journal:  Psychol Bull       Date:  2013-07-08       Impact factor: 17.737

2.  Optimal indolence: a normative microscopic approach to work and leisure.

Authors:  Ritwik K Niyogi; Yannick-Andre Breton; Rebecca B Solomon; Kent Conover; Peter Shizgal; Peter Dayan
Journal:  J R Soc Interface       Date:  2013-11-27       Impact factor: 4.118

3.  The good, the bad and the brain: Neural correlates of appetitive and aversive values underlying decision making.

Authors:  Mathias Pessiglione; Mauricio R Delgado
Journal:  Curr Opin Behav Sci       Date:  2015-08-24

Review 4.  Optimal response vigor and choice under non-stationary outcome values.

Authors:  Amir Dezfouli; Bernard W Balleine; Richard Nock
Journal:  Psychon Bull Rev       Date:  2019-02

5.  Dopamine modulates reward-related vigor.

Authors:  Ulrik Beierholm; Marc Guitart-Masip; Marcos Economides; Rumana Chowdhury; Emrah Düzel; Ray Dolan; Peter Dayan
Journal:  Neuropsychopharmacology       Date:  2013-02-18       Impact factor: 7.853

6.  A reinforcement-learning model of active avoidance behavior: Differences between Sprague Dawley and Wistar-Kyoto rats.

Authors:  Kevin M Spiegler; John Palmieri; Kevin C H Pang; Catherine E Myers
Journal:  Behav Brain Res       Date:  2020-06-22       Impact factor: 3.332

7.  Visual attention modulates the integration of goal-relevant evidence and not value.

Authors:  Pradyumna Sepulveda; Marius Usher; Ned Davies; Amy A Benson; Pietro Ortoleva; Benedetto De Martino
Journal:  Elife       Date:  2020-11-17       Impact factor: 8.140

8.  Subsecond dopamine release in the nucleus accumbens predicts conditioned punishment and its successful avoidance.

Authors:  Erik B Oleson; Ronny N Gentry; Vivian C Chioma; Joseph F Cheer
Journal:  J Neurosci       Date:  2012-10-17       Impact factor: 6.167

Review 9.  The neurobiology of psychopathic traits in youths.

Authors:  R James R Blair
Journal:  Nat Rev Neurosci       Date:  2013-10-09       Impact factor: 34.870

10.  Effort and valuation in the brain: the effects of anticipation and execution.

Authors:  Irma T Kurniawan; Marc Guitart-Masip; Peter Dayan; Raymond J Dolan
Journal:  J Neurosci       Date:  2013-04-03       Impact factor: 6.167

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.