Literature DB >> 19955362

Dopaminergic drugs modulate learning rates and perseveration in Parkinson's patients in a dynamic foraging task.

Robb B Rutledge1, Stephanie C Lazzaro, Brian Lau, Catherine E Myers, Mark A Gluck, Paul W Glimcher.   

Abstract

Making appropriate choices often requires the ability to learn the value of available options from experience. Parkinson's disease is characterized by a loss of dopamine neurons in the substantia nigra, neurons hypothesized to play a role in reinforcement learning. Although previous studies have shown that Parkinson's patients are impaired in tasks involving learning from feedback, they have not directly tested the widely held hypothesis that dopamine neuron activity specifically encodes the reward prediction error signal used in reinforcement learning models. To test a key prediction of this hypothesis, we fit choice behavior from a dynamic foraging task with reinforcement learning models and show that treatment with dopaminergic drugs alters choice behavior in a manner consistent with the theory. More specifically, we found that dopaminergic drugs selectively modulate learning from positive outcomes. We observed no effect of dopaminergic drugs on learning from negative outcomes. We also found a novel dopamine-dependent effect on decision making that is not accounted for by reinforcement learning models: perseveration in choice, independent of reward history, increases with Parkinson's disease and decreases with dopamine therapy.

Entities:  

Mesh:

Substances:

Year:  2009        PMID: 19955362      PMCID: PMC3376711          DOI: 10.1523/JNEUROSCI.3524-09.2009

Source DB:  PubMed          Journal:  J Neurosci        ISSN: 0270-6474            Impact factor:   6.167


  55 in total

Review 1.  Opponent interactions between serotonin and dopamine.

Authors:  Nathaniel D Daw; Sham Kakade; Peter Dayan
Journal:  Neural Netw       Date:  2002 Jun-Jul

2.  Matching behavior and the representation of value in the parietal cortex.

Authors:  Leo P Sugrue; Greg S Corrado; William T Newsome
Journal:  Science       Date:  2004-06-18       Impact factor: 47.728

3.  Dopaminergic basis for deficits in working memory but not attentional set-shifting in Parkinson's disease.

Authors:  Simon J G Lewis; Aleksandra Slabosz; Trevor W Robbins; Roger A Barker; Adrian M Owen
Journal:  Neuropsychologia       Date:  2004-12-21       Impact factor: 3.139

Review 4.  A neural substrate of prediction and reward.

Authors:  W Schultz; P Dayan; P R Montague
Journal:  Science       Date:  1997-03-14       Impact factor: 47.728

5.  Parkinsonism: onset, progression and mortality.

Authors:  M M Hoehn; M D Yahr
Journal:  Neurology       Date:  1967-05       Impact factor: 9.910

6.  A mechanistic account of striatal dopamine function in human cognition: psychopharmacological studies with cabergoline and haloperidol.

Authors:  Michael J Frank; Randall C O'Reilly
Journal:  Behav Neurosci       Date:  2006-06       Impact factor: 1.912

7.  Cognitive deficits in the early stages of Parkinson's disease.

Authors:  A J Lees; E Smith
Journal:  Brain       Date:  1983-06       Impact factor: 13.501

8.  Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making.

Authors:  Tom Schönberg; Nathaniel D Daw; Daphna Joel; John P O'Doherty
Journal:  J Neurosci       Date:  2007-11-21       Impact factor: 6.167

9.  Cortico-striatal contributions to feedback-based learning: converging data from neuroimaging and neuropsychology.

Authors:  D Shohamy; C E Myers; S Grossman; J Sage; M A Gluck; R A Poldrack
Journal:  Brain       Date:  2004-03-10       Impact factor: 13.501

10.  Reward-learning and the novelty-seeking personality: a between- and within-subjects study of the effects of dopamine agonists on young Parkinson's patients.

Authors:  Nikoletta Bódi; Szabolcs Kéri; Helga Nagy; Ahmed Moustafa; Catherine E Myers; Nathaniel Daw; György Dibó; Annamária Takáts; Dániel Bereczki; Mark A Gluck
Journal:  Brain       Date:  2009-05-04       Impact factor: 13.501

View more
  100 in total

1.  Testing the reward prediction error hypothesis with an axiomatic model.

Authors:  Robb B Rutledge; Mark Dean; Andrew Caplin; Paul W Glimcher
Journal:  J Neurosci       Date:  2010-10-06       Impact factor: 6.167

Review 2.  Dopamine in motivational control: rewarding, aversive, and alerting.

Authors:  Ethan S Bromberg-Martin; Masayuki Matsumoto; Okihide Hikosaka
Journal:  Neuron       Date:  2010-12-09       Impact factor: 17.173

3.  Bursts of beta oscillation differentiate postperformance activity in the striatum and motor cortex of monkeys performing movement tasks.

Authors:  Joseph Feingold; Daniel J Gibson; Brian DePasquale; Ann M Graybiel
Journal:  Proc Natl Acad Sci U S A       Date:  2015-10-12       Impact factor: 11.205

4.  Executive function in Parkinson's disease: contributions of the dorsal frontostriatal pathways to action and motivation.

Authors:  Susan M Ravizza; John Goudreau; Mauricio R Delgado; Sandra Ruiz
Journal:  Cogn Affect Behav Neurosci       Date:  2012-03       Impact factor: 3.282

5.  Dopaminergic Modulation of Decision Making and Subjective Well-Being.

Authors:  Robb B Rutledge; Nikolina Skandali; Peter Dayan; Raymond J Dolan
Journal:  J Neurosci       Date:  2015-07-08       Impact factor: 6.167

Review 6.  Age-related variability in decision-making: Insights from neurochemistry.

Authors:  Anne S Berry; William J Jagust; Ming Hsu
Journal:  Cogn Affect Behav Neurosci       Date:  2019-06       Impact factor: 3.282

7.  Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models.

Authors:  Vincent S Huang; Adrian Haith; Pietro Mazzoni; John W Krakauer
Journal:  Neuron       Date:  2011-05-26       Impact factor: 17.173

8.  Motivational Context Modulates Prediction Error Response in Schizophrenia.

Authors:  Jenna M Reinen; Jared X Van Snellenberg; Guillermo Horga; Anissa Abi-Dargham; Nathaniel D Daw; Daphna Shohamy
Journal:  Schizophr Bull       Date:  2016-04-22       Impact factor: 9.306

9.  Probabilistic reward- and punishment-based learning in opioid addiction: Experimental and computational data.

Authors:  Catherine E Myers; Jony Sheynin; Tarryn Balsdon; Andre Luzardo; Kevin D Beck; Lee Hogarth; Paul Haber; Ahmed A Moustafa
Journal:  Behav Brain Res       Date:  2015-09-14       Impact factor: 3.332

10.  Dynamical regimes in neural network models of matching behavior.

Authors:  Kiyohito Iigaya; Stefano Fusi
Journal:  Neural Comput       Date:  2013-09-18       Impact factor: 2.026

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.