Literature DB >> 16929307

Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans.

Mathias Pessiglione1, Ben Seymour, Guillaume Flandin, Raymond J Dolan, Chris D Frith.   

Abstract

Theories of instrumental learning are centred on understanding how success and failure are used to improve future decisions. These theories highlight a central role for reward prediction errors in updating the values associated with available actions. In animals, substantial evidence indicates that the neurotransmitter dopamine might have a key function in this type of learning, through its ability to modulate cortico-striatal synaptic efficacy. However, no direct evidence links dopamine, striatal activity and behavioural choice in humans. Here we show that, during instrumental learning, the magnitude of reward prediction error expressed in the striatum is modulated by the administration of drugs enhancing (3,4-dihydroxy-L-phenylalanine; L-DOPA) or reducing (haloperidol) dopaminergic function. Accordingly, subjects treated with L-DOPA have a greater propensity to choose the most rewarding action relative to subjects treated with haloperidol. Furthermore, incorporating the magnitude of the prediction errors into a standard action-value learning algorithm accurately reproduced subjects' behavioural choices under the different drug conditions. We conclude that dopamine-dependent modulation of striatal activity can account for how the human brain uses reward prediction errors to improve future decisions.

Entities:  

Mesh:

Substances:

Year:  2006        PMID: 16929307      PMCID: PMC2636869          DOI: 10.1038/nature05051

Source DB:  PubMed          Journal:  Nature        ISSN: 0028-0836            Impact factor:   49.962


  27 in total

1.  Neural responses during anticipation of a primary taste reward.

Authors:  John P O'Doherty; Ralf Deichmann; Hugo D Critchley; Raymond J Dolan
Journal:  Neuron       Date:  2002-02-28       Impact factor: 17.173

Review 2.  The primate basal ganglia: parallel and integrative networks.

Authors:  Suzanne N Haber
Journal:  J Chem Neuroanat       Date:  2003-12       Impact factor: 3.052

3.  A neural correlate of response bias in monkey caudate nucleus.

Authors:  Johan Lauwereyns; Katsumi Watanabe; Brian Coe; Okihide Hikosaka
Journal:  Nature       Date:  2002-07-25       Impact factor: 49.962

4.  Motor control in basal ganglia circuits using fMRI and brain atlas approaches.

Authors:  Stéphane Lehéricy; Eric Bardinet; Leon Tremblay; Pierre-Francois Van de Moortele; Jean-Baptiste Pochon; Didier Dormont; Dae-Shik Kim; Jerome Yelnik; Kamil Ugurbil
Journal:  Cereb Cortex       Date:  2005-04-27       Impact factor: 5.357

Review 5.  The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking.

Authors:  S Ikemoto; J Panksepp
Journal:  Brain Res Brain Res Rev       Date:  1999-12

6.  Dopamine responses comply with basic assumptions of formal learning theory.

Authors:  P Waelti; A Dickinson; W Schultz
Journal:  Nature       Date:  2001-07-05       Impact factor: 49.962

7.  Pathologic gambling in Parkinson's disease: a behavioral manifestation of pharmacologic treatment?

Authors:  J A Molina; M J Sáinz-Artiga; A Fraile; F J Jiménez-Jiménez; C Villanueva; M Ortí-Pareja; F Bermejo
Journal:  Mov Disord       Date:  2000-09       Impact factor: 10.338

8.  Dissociable roles of ventral and dorsal striatum in instrumental conditioning.

Authors:  John O'Doherty; Peter Dayan; Johannes Schultz; Ralf Deichmann; Karl Friston; Raymond J Dolan
Journal:  Science       Date:  2004-04-16       Impact factor: 47.728

9.  Dopamine neurons can represent context-dependent prediction error.

Authors:  Hiroyuki Nakahara; Hideaki Itoh; Reiko Kawagoe; Yoriko Takikawa; Okihide Hikosaka
Journal:  Neuron       Date:  2004-01-22       Impact factor: 17.173

10.  Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli.

Authors:  Mark A Ungless; Peter J Magill; J Paul Bolam
Journal:  Science       Date:  2004-03-26       Impact factor: 47.728

View more
  545 in total

1.  Dopaminergic reward system: a short integrative review.

Authors:  Oscar Arias-Carrión; Maria Stamelou; Eric Murillo-Rodríguez; Manuel Menéndez-González; Ernst Pöppel
Journal:  Int Arch Med       Date:  2010-10-06

2.  Testing the reward prediction error hypothesis with an axiomatic model.

Authors:  Robb B Rutledge; Mark Dean; Andrew Caplin; Paul W Glimcher
Journal:  J Neurosci       Date:  2010-10-06       Impact factor: 6.167

3.  Value is in the eye of the beholder: early visual cortex codes monetary value of objects during a diverted attention task.

Authors:  Andrew S Persichetti; Geoffrey K Aguirre; Sharon L Thompson-Schill
Journal:  J Cogn Neurosci       Date:  2014-11-12       Impact factor: 3.225

4.  Changes in corticostriatal connectivity during reinforcement learning in humans.

Authors:  Guillermo Horga; Tiago V Maia; Rachel Marsh; Xuejun Hao; Dongrong Xu; Yunsuo Duan; Gregory Z Tau; Barbara Graniello; Zhishun Wang; Alayar Kangarlu; Diana Martinez; Mark G Packard; Bradley S Peterson
Journal:  Hum Brain Mapp       Date:  2014-11-12       Impact factor: 5.038

5.  Imaging human reward processing with positron emission tomography and functional magnetic resonance imaging.

Authors:  Nina B L Urban; Mark Slifstein; Shashwath Meda; Xiaoyan Xu; Rawad Ayoub; Olga Medina; Godfrey D Pearlson; John H Krystal; Anissa Abi-Dargham
Journal:  Psychopharmacology (Berl)       Date:  2011-11-04       Impact factor: 4.530

Review 6.  A computational framework for the study of confidence in humans and animals.

Authors:  Adam Kepecs; Zachary F Mainen
Journal:  Philos Trans R Soc Lond B Biol Sci       Date:  2012-05-19       Impact factor: 6.237

Review 7.  CISDA: Changes in Integration for Social Decisions in Aging.

Authors:  Ian Frazier; Nichole R Lighthall; Marilyn Horta; Eliany Perez; Natalie C Ebner
Journal:  Wiley Interdiscip Rev Cogn Sci       Date:  2019-01-03

8.  BDNF Val66Met polymorphism tunes frontolimbic circuitry during affective contextual learning.

Authors:  Mbemba Jabbi; Brett Cropp; Tiffany Nash; Philip Kohn; J Shane Kippenhan; Joseph C Masdeu; Raghav Mattay; Bhaskar Kolachana; Karen F Berman
Journal:  Neuroimage       Date:  2017-09-01       Impact factor: 6.556

9.  Early deprivation, atypical brain development, and internalizing symptoms in late childhood.

Authors:  J Bick; N Fox; C Zeanah; C A Nelson
Journal:  Neuroscience       Date:  2015-09-16       Impact factor: 3.590

10.  Computational substrates of norms and their violations during social exchange.

Authors:  Ting Xiang; Terry Lohrenz; P Read Montague
Journal:  J Neurosci       Date:  2013-01-16       Impact factor: 6.167

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.