Literature DB >> 25297101

Working memory contributions to reinforcement learning impairments in schizophrenia.

Anne G E Collins1, Jaime K Brown2, James M Gold2, James A Waltz2, Michael J Frank3.   

Abstract

Previous research has shown that patients with schizophrenia are impaired in reinforcement learning tasks. However, behavioral learning curves in such tasks originate from the interaction of multiple neural processes, including the basal ganglia- and dopamine-dependent reinforcement learning (RL) system, but also prefrontal cortex-dependent cognitive strategies involving working memory (WM). Thus, it is unclear which specific system induces impairments in schizophrenia. We recently developed a task and computational model allowing us to separately assess the roles of RL (slow, cumulative learning) mechanisms versus WM (fast but capacity-limited) mechanisms in healthy adult human subjects. Here, we used this task to assess patients' specific sources of impairments in learning. In 15 separate blocks, subjects learned to pick one of three actions for stimuli. The number of stimuli to learn in each block varied from two to six, allowing us to separate influences of capacity-limited WM from the incremental RL system. As expected, both patients (n = 49) and healthy controls (n = 36) showed effects of set size and delay between stimulus repetitions, confirming the presence of working memory effects. Patients performed significantly worse than controls overall, but computational model fits and behavioral analyses indicate that these deficits could be entirely accounted for by changes in WM parameters (capacity and reliability), whereas RL processes were spared. These results suggest that the working memory system contributes strongly to learning impairments in schizophrenia.
Copyright © 2014 the authors 0270-6474/14/3413747-10$15.00/0.

Entities:  

Keywords:  computational model; reinforcement learning; schizophrenia; working memory

Mesh:

Substances:

Year:  2014        PMID: 25297101      PMCID: PMC4188972          DOI: 10.1523/JNEUROSCI.0989-14.2014

Source DB:  PubMed          Journal:  J Neurosci        ISSN: 0270-6474            Impact factor:   6.167


  52 in total

Review 1.  Model-based fMRI and its application to reward learning and decision making.

Authors:  John P O'Doherty; Alan Hampton; Hackjin Kim
Journal:  Ann N Y Acad Sci       Date:  2007-04-07       Impact factor: 5.691

2.  Impaired neural response to internal but not external feedback in schizophrenia.

Authors:  W P Horan; D Foti; G Hajcak; J K Wynn; M F Green
Journal:  Psychol Med       Date:  2011-12-08       Impact factor: 7.723

3.  Computational psychiatry.

Authors:  P Read Montague; Raymond J Dolan; Karl J Friston; Peter Dayan
Journal:  Trends Cogn Sci       Date:  2011-12-14       Impact factor: 20.229

4.  Deficits on conditional associative-learning tasks after frontal- and temporal-lobe lesions in man.

Authors:  M Petrides
Journal:  Neuropsychologia       Date:  1985       Impact factor: 3.139

5.  Typical and atypical antipsychotic medications differentially affect two nondeclarative memory tasks in schizophrenic patients: a double dissociation.

Authors:  Richard J Beninger; James Wasserman; Katherine Zanibbi; Danielle Charbonneau; Jennifer Mangels; Bruce V Beninger
Journal:  Schizophr Res       Date:  2003-06-01       Impact factor: 4.939

6.  Further evidence for dementia of the prefrontal type in schizophrenia? A controlled study of teaching the Wisconsin Card Sorting Test.

Authors:  T E Goldberg; D R Weinberger; K F Berman; N H Pliskin; M H Podd
Journal:  Arch Gen Psychiatry       Date:  1987-11

7.  Dissociation of response and feedback negativity in schizophrenia: electrophysiological and computational evidence for a deficit in the representation of value.

Authors:  Sarah E Morris; Clay B Holroyd; Monica C Mann-Wrobel; James M Gold
Journal:  Front Hum Neurosci       Date:  2011-10-28       Impact factor: 3.169

Review 8.  Reinforcement learning and dopamine in schizophrenia: dimensions of symptoms or specific features of a disease group?

Authors:  Lorenz Deserno; Rebecca Boehme; Andreas Heinz; Florian Schlagenhauf
Journal:  Front Psychiatry       Date:  2013-12-23       Impact factor: 4.157

9.  Substantia nigra/ventral tegmental reward prediction error disruption in psychosis.

Authors:  G K Murray; P R Corlett; L Clark; M Pessiglione; A D Blackwell; G Honey; P B Jones; E T Bullmore; T W Robbins; P C Fletcher
Journal:  Mol Psychiatry       Date:  2007-08-07       Impact factor: 15.992

10.  Striatal dysfunction during reversal learning in unmedicated schizophrenia patients.

Authors:  Florian Schlagenhauf; Quentin J M Huys; Lorenz Deserno; Michael A Rapp; Anne Beck; Hans-Joachim Heinze; Ray Dolan; Andreas Heinz
Journal:  Neuroimage       Date:  2013-11-27       Impact factor: 6.556

View more
  61 in total

1.  Selective maintenance of value information helps resolve the exploration/exploitation dilemma.

Authors:  Michael N Hallquist; Alexandre Y Dombrovski
Journal:  Cognition       Date:  2018-11-28

2.  Explicit and implicit reinforcement learning across the psychosis spectrum.

Authors:  Deanna M Barch; Cameron S Carter; James M Gold; Sheri L Johnson; Ann M Kring; Angus W MacDonald; Diego A Pizzagalli; J Daniel Ragland; Steven M Silverstein; Milton E Strauss
Journal:  J Abnorm Psychol       Date:  2017-04-13

3.  Impaired Activation in Cognitive Control Regions Predicts Reversal Learning in Schizophrenia.

Authors:  Adam J Culbreth; James M Gold; Roshan Cools; Deanna M Barch
Journal:  Schizophr Bull       Date:  2015-06-06       Impact factor: 9.306

4.  Dopaminergic circuitry and risk/reward decision making: implications for schizophrenia.

Authors:  Colin M Stopper; Stan B Floresco
Journal:  Schizophr Bull       Date:  2014-11-17       Impact factor: 9.306

Review 5.  Spine dynamics in the brain, mental disorders and artificial neural networks.

Authors:  Haruo Kasai; Noam E Ziv; Hitoshi Okazaki; Sho Yagishita; Taro Toyoizumi
Journal:  Nat Rev Neurosci       Date:  2021-05-28       Impact factor: 34.870

6.  Reinforcement learning with Marr.

Authors:  Yael Niv; Angela Langdon
Journal:  Curr Opin Behav Sci       Date:  2016-10

7.  Reward Learning over Weeks Versus Minutes Increases the Neural Representation of Value in the Human Brain.

Authors:  G Elliott Wimmer; Jamie K Li; Krzysztof J Gorgolewski; Russell A Poldrack
Journal:  J Neurosci       Date:  2018-07-30       Impact factor: 6.167

8.  Neural Signatures of Prediction Errors in a Decision-Making Task Are Modulated by Action Execution Failures.

Authors:  Samuel D McDougle; Peter A Butcher; Darius E Parvin; Fasial Mushtaq; Yael Niv; Richard B Ivry; Jordan A Taylor
Journal:  Curr Biol       Date:  2019-05-02       Impact factor: 10.834

9.  Taming the beast: extracting generalizable knowledge from computational models of cognition.

Authors:  Matthew R Nassar; Michael J Frank
Journal:  Curr Opin Behav Sci       Date:  2016-10

Review 10.  An Integrative Perspective on the Role of Dopamine in Schizophrenia.

Authors:  Tiago V Maia; Michael J Frank
Journal:  Biol Psychiatry       Date:  2016-06-01       Impact factor: 13.382

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.