Anne G E Collins1, Matthew A Albrecht2, James A Waltz3, James M Gold3, Michael J Frank4. 1. Helen Wills Neuroscience Institute, Department of Psychology, University of California, Berkeley, Berkeley, California. Electronic address: annecollins@berkeley.edu. 2. Maryland Psychiatric Research Center, Department of Psychiatry, University of Maryland School of Medicine, Baltimore, Maryland; Curtin Health Innovation Research Institute, School of Public Health, Curtin University, Perth, Western Australia, Australia. 3. Maryland Psychiatric Research Center, Department of Psychiatry, University of Maryland School of Medicine, Baltimore, Maryland. 4. Brown Institute for Brain Sciences, Department of Cognitive Linguistic and Psychological Science, Brown University, Providence, Rhode Island.
Abstract
BACKGROUND: When studying learning, researchers directly observe only the participants' choices, which are often assumed to arise from a unitary learning process. However, a number of separable systems, such as working memory (WM) and reinforcement learning (RL), contribute simultaneously to human learning. Identifying each system's contributions is essential for mapping the neural substrates contributing in parallel to behavior; computational modeling can help to design tasks that allow such a separable identification of processes and infer their contributions in individuals. METHODS: We present a new experimental protocol that separately identifies the contributions of RL and WM to learning, is sensitive to parametric variations in both, and allows us to investigate whether the processes interact. In experiments 1 and 2, we tested this protocol with healthy young adults (n = 29 and n = 52, respectively). In experiment 3, we used it to investigate learning deficits in medicated individuals with schizophrenia (n = 49 patients, n = 32 control subjects). RESULTS: Experiments 1 and 2 established WM and RL contributions to learning, as evidenced by parametric modulations of choice by load and delay and reward history, respectively. They also showed interactions between WM and RL, where RL was enhanced under high WM load. Moreover, we observed a cost of mental effort when controlling for reinforcement history: participants preferred stimuli they encountered under low WM load. Experiment 3 revealed selective deficits in WM contributions and preserved RL value learning in individuals with schizophrenia compared with control subjects. CONCLUSIONS: Computational approaches allow us to disentangle contributions of multiple systems to learning and, consequently, to further our understanding of psychiatric diseases.
BACKGROUND: When studying learning, researchers directly observe only the participants' choices, which are often assumed to arise from a unitary learning process. However, a number of separable systems, such as working memory (WM) and reinforcement learning (RL), contribute simultaneously to human learning. Identifying each system's contributions is essential for mapping the neural substrates contributing in parallel to behavior; computational modeling can help to design tasks that allow such a separable identification of processes and infer their contributions in individuals. METHODS: We present a new experimental protocol that separately identifies the contributions of RL and WM to learning, is sensitive to parametric variations in both, and allows us to investigate whether the processes interact. In experiments 1 and 2, we tested this protocol with healthy young adults (n = 29 and n = 52, respectively). In experiment 3, we used it to investigate learning deficits in medicated individuals with schizophrenia (n = 49 patients, n = 32 control subjects). RESULTS: Experiments 1 and 2 established WM and RL contributions to learning, as evidenced by parametric modulations of choice by load and delay and reward history, respectively. They also showed interactions between WM and RL, where RL was enhanced under high WM load. Moreover, we observed a cost of mental effort when controlling for reinforcement history: participants preferred stimuli they encountered under low WM load. Experiment 3 revealed selective deficits in WM contributions and preserved RL value learning in individuals with schizophrenia compared with control subjects. CONCLUSIONS: Computational approaches allow us to disentangle contributions of multiple systems to learning and, consequently, to further our understanding of psychiatric diseases.
Authors: James M Gold; Gregory P Strauss; James A Waltz; Benjamin M Robinson; Jamie K Brown; Michael J Frank Journal: Biol Psychiatry Date: 2013-02-07 Impact factor: 13.382
Authors: James A Waltz; Zuzana Kasanova; Thomas J Ross; Betty J Salmeron; Robert P McMahon; James M Gold; Elliot A Stein Journal: PLoS One Date: 2013-02-27 Impact factor: 3.240
Authors: Pablo Vidal-Ribas; Brenda Benson; Aria D Vitale; Hanna Keren; Anita Harrewijn; Nathan A Fox; Daniel S Pine; Argyris Stringaris Journal: Biol Psychiatry Cogn Neurosci Neuroimaging Date: 2019-06-03
Authors: Henry W Chase; Polina Loriemi; Tobias Wensing; Simon B Eickhoff; Thomas Nickl-Jockschat Journal: Hum Brain Mapp Date: 2018-03-24 Impact factor: 5.038