Dennis Hernaus1, James M Gold2, James A Waltz2, Michael J Frank3. 1. Maryland Psychiatric Research Center, Department of Psychiatry, University of Maryland School of Medicine, Baltimore, Maryland. Electronic address: dhernaus@som.umaryland.edu. 2. Maryland Psychiatric Research Center, Department of Psychiatry, University of Maryland School of Medicine, Baltimore, Maryland. 3. Department of Cognitive, Linguistic & Psychological Sciences and Department of Psychiatry and Human Behavior, Brown University, Providence, Rhode Island.
Abstract
BACKGROUND: While many have emphasized impaired reward prediction error signaling in schizophrenia, multiple studies suggest that some decision-making deficits may arise from overreliance on stimulus-response systems together with a compromised ability to represent expected value. Guided by computational frameworks, we formulated and tested two scenarios in which maladaptive representations of expected value should be most evident, thereby delineating conditions that may evoke decision-making impairments in schizophrenia. METHODS: In a modified reinforcement learning paradigm, 42 medicated people with schizophrenia and 36 healthy volunteers learned to select the most frequently rewarded option in a 75-25 pair: once when presented with a more deterministic (90-10) pair and once when presented with a more probabilistic (60-40) pair. Novel and old combinations of choice options were presented in a subsequent transfer phase. Computational modeling was employed to elucidate contributions from stimulus-response systems (actor-critic) and expected value (Q-learning). RESULTS: People with schizophrenia showed robust performance impairments with increasing value difference between two competing options, which strongly correlated with decreased contributions from expected value-based learning (Q-learning). Moreover, a subtle yet consistent contextual choice bias for the probabilistic 75 option was present in people with schizophrenia, which could be accounted for by a context-dependent reward prediction error in the actor-critic. CONCLUSIONS: We provide evidence that decision-making impairments in schizophrenia increase monotonically with demands placed on expected value computations. A contextual choice bias is consistent with overreliance on stimulus-response learning, which may signify a deficit secondary to the maladaptive representation of expected value. These results shed new light on conditions under which decision-making impairments may arise.
BACKGROUND: While many have emphasized impaired reward prediction error signaling in schizophrenia, multiple studies suggest that some decision-making deficits may arise from overreliance on stimulus-response systems together with a compromised ability to represent expected value. Guided by computational frameworks, we formulated and tested two scenarios in which maladaptive representations of expected value should be most evident, thereby delineating conditions that may evoke decision-making impairments in schizophrenia. METHODS: In a modified reinforcement learning paradigm, 42 medicated people with schizophrenia and 36 healthy volunteers learned to select the most frequently rewarded option in a 75-25 pair: once when presented with a more deterministic (90-10) pair and once when presented with a more probabilistic (60-40) pair. Novel and old combinations of choice options were presented in a subsequent transfer phase. Computational modeling was employed to elucidate contributions from stimulus-response systems (actor-critic) and expected value (Q-learning). RESULTS: People with schizophrenia showed robust performance impairments with increasing value difference between two competing options, which strongly correlated with decreased contributions from expected value-based learning (Q-learning). Moreover, a subtle yet consistent contextual choice bias for the probabilistic 75 option was present in people with schizophrenia, which could be accounted for by a context-dependent reward prediction error in the actor-critic. CONCLUSIONS: We provide evidence that decision-making impairments in schizophrenia increase monotonically with demands placed on expected value computations. A contextual choice bias is consistent with overreliance on stimulus-response learning, which may signify a deficit secondary to the maladaptive representation of expected value. These results shed new light on conditions under which decision-making impairments may arise.
Authors: James M Gold; James A Waltz; Tatyana M Matveeva; Zuzana Kasanova; Gregory P Strauss; Ellen S Herbener; Anne G E Collins; Michael J Frank Journal: Arch Gen Psychiatry Date: 2012-02
Authors: Wing Chung Chang; James A Waltz; James M Gold; Tracey Chi Wan Chan; Eric Yu Hai Chen Journal: Schizophr Bull Date: 2016-05-13 Impact factor: 9.306
Authors: James A Waltz; Ziye Xu; Elliot C Brown; Rebecca R Ruiz; Michael J Frank; James M Gold Journal: Biol Psychiatry Cogn Neurosci Neuroimaging Date: 2017-08-12
Authors: P Calabresi; P Gubellini; D Centonze; B Picconi; G Bernardi; K Chergui; P Svenningsson; A A Fienberg; P Greengard Journal: J Neurosci Date: 2000-11-15 Impact factor: 6.167
Authors: Dennis Hernaus; Michael J Frank; Elliot C Brown; Jaime K Brown; James M Gold; James A Waltz Journal: Biol Psychiatry Cogn Neurosci Neuroimaging Date: 2018-12-07
Authors: Andra Geana; Deanna M Barch; James M Gold; Cameron S Carter; Angus W MacDonald; J Daniel Ragland; Steven M Silverstein; Michael J Frank Journal: Biol Psychiatry Cogn Neurosci Neuroimaging Date: 2021-04-18
Authors: V H Dam; D S Stenbæk; K Köhler-Forsberg; C Ip; B Ozenne; B J Sahakian; G M Knudsen; M B Jørgensen; V G Frokjaer Journal: Psychol Med Date: 2020-04-22 Impact factor: 7.723