Literature DB >> 33878489

Using Computational Modeling to Capture Schizophrenia-Specific Reinforcement Learning Differences and Their Implications on Patient Classification.

Andra Geana1, Deanna M Barch2, James M Gold3, Cameron S Carter4, Angus W MacDonald5, J Daniel Ragland4, Steven M Silverstein6, Michael J Frank7.   

Abstract

BACKGROUND: Psychiatric diagnosis and treatment have historically taken a symptom-based approach, with less attention on identifying underlying symptom-producing mechanisms. Recent efforts have illuminated the extent to which different underlying circuitry can produce phenotypically similar symptomatology (e.g., psychosis in bipolar disorder vs. schizophrenia). Computational modeling makes it possible to identify and mathematically differentiate behaviorally unobservable, specific reinforcement learning differences in patients with schizophrenia versus other disorders, likely owing to a higher reliance on prediction error-driven learning associated with basal ganglia and underreliance on explicit value representations associated with orbitofrontal cortex.
METHODS: We used a well-established probabilistic reinforcement learning task to replicate those findings in individuals with schizophrenia both on (n = 120) and off (n = 44) antipsychotic medications and included a patient comparison group of bipolar patients with psychosis (n = 60) and healthy control subjects (n = 72).
RESULTS: Using accuracy, there was a main effect of group (F3,279 = 7.87, p < .001), such that all patient groups were less accurate than control subjects. Using computationally derived parameters, both medicated and unmediated individuals with schizophrenia, but not patients with bipolar disorder, demonstrated a reduced mixing parameter (F3,295 = 13.91, p < .001), indicating less dependence on learning explicit value representations as well as greater learning decay between training and test (F1,289 = 12.81, p < .001). Unmedicated patients with schizophrenia also showed greater decision noise (F3,295 = 2.67, p = .04).
CONCLUSIONS: Both medicated and unmedicated patients showed overreliance on prediction error-driven learning as well as significantly higher noise and value-related memory decay, compared with the healthy control subjects and the patients with bipolar disorder. Additionally, the computational model parameters capturing these processes can significantly improve patient/control classification, potentially providing useful diagnosis insight.
Copyright © 2021 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Entities:  

Keywords:  Classification; Computational psychiatry; Modeling; Reinforcement learning; Schizophrenia

Mesh:

Substances:

Year:  2021        PMID: 33878489      PMCID: PMC9272137          DOI: 10.1016/j.bpsc.2021.03.017

Source DB:  PubMed          Journal:  Biol Psychiatry Cogn Neurosci Neuroimaging        ISSN: 2451-9022


  44 in total

1.  Altered probabilistic learning and response biases in schizophrenia: behavioral evidence and neurocomputational modeling.

Authors:  James A Waltz; Michael J Frank; Thomas V Wiecki; James M Gold
Journal:  Neuropsychology       Date:  2011-01       Impact factor: 3.295

2.  The effects of aging on the interaction between reinforcement learning and attention.

Authors:  Angela Radulescu; Reka Daniel; Yael Niv
Journal:  Psychol Aging       Date:  2016-09-05

3.  All roads to schizophrenia lead to dopamine supersensitivity and elevated dopamine D2(high) receptors.

Authors:  Philip Seeman
Journal:  CNS Neurosci Ther       Date:  2011-04       Impact factor: 5.243

4.  Working memory contributions to reinforcement learning impairments in schizophrenia.

Authors:  Anne G E Collins; Jaime K Brown; James M Gold; James A Waltz; Michael J Frank
Journal:  J Neurosci       Date:  2014-10-08       Impact factor: 6.167

5.  Uncertainty and Exploration.

Authors:  Samuel J Gershman
Journal:  Decision (Wash D C )       Date:  2018-10-01

Review 6.  Reward processing dysfunction in major depression, bipolar disorder and schizophrenia.

Authors:  Alexis E Whitton; Michael T Treadway; Diego A Pizzagalli
Journal:  Curr Opin Psychiatry       Date:  2015-01       Impact factor: 4.741

7.  Impaired strategic decision making in schizophrenia.

Authors:  Hyojin Kim; Daeyeol Lee; Young-Min Shin; Jeanyung Chey
Journal:  Brain Res       Date:  2007-08-28       Impact factor: 3.252

8.  A review of reward processing and motivational impairment in schizophrenia.

Authors:  Gregory P Strauss; James A Waltz; James M Gold
Journal:  Schizophr Bull       Date:  2013-12-27       Impact factor: 9.306

9.  The nature of dopamine dysfunction in schizophrenia and what this means for treatment.

Authors:  Oliver D Howes; Joseph Kambeitz; Euitae Kim; Daniel Stahl; Mark Slifstein; Anissa Abi-Dargham; Shitij Kapur
Journal:  Arch Gen Psychiatry       Date:  2012-08

10.  Treatments of Negative Symptoms in Schizophrenia: Meta-Analysis of 168 Randomized Placebo-Controlled Trials.

Authors:  Paolo Fusar-Poli; Evangelos Papanastasiou; Daniel Stahl; Matteo Rocchetti; William Carpenter; Sukhwinder Shergill; Philip McGuire
Journal:  Schizophr Bull       Date:  2014-12-20       Impact factor: 9.306

View more
  2 in total

Review 1.  Computational Psychiatry Needs Time and Context.

Authors:  Peter F Hitchcock; Eiko I Fried; Michael J Frank
Journal:  Annu Rev Psychol       Date:  2021-09-27       Impact factor: 24.137

2.  The Role of Dopaminergic Genes in Probabilistic Reinforcement Learning in Schizophrenia Spectrum Disorders.

Authors:  Dorota Frydecka; Błażej Misiak; Patryk Piotrowski; Tomasz Bielawski; Edyta Pawlak; Ewa Kłosińska; Maja Krefft; Kamila Al Noaimy; Joanna Rymaszewska; Ahmed A Moustafa; Jarosław Drapała
Journal:  Brain Sci       Date:  2021-12-22
  2 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.