Literature DB >> 25393839

Changes in corticostriatal connectivity during reinforcement learning in humans.

Guillermo Horga1, Tiago V Maia, Rachel Marsh, Xuejun Hao, Dongrong Xu, Yunsuo Duan, Gregory Z Tau, Barbara Graniello, Zhishun Wang, Alayar Kangarlu, Diana Martinez, Mark G Packard, Bradley S Peterson.   

Abstract

Many computational models assume that reinforcement learning relies on changes in synaptic efficacy between cortical regions representing stimuli and striatal regions involved in response selection, but this assumption has thus far lacked empirical support in humans. We recorded hemodynamic signals with fMRI while participants navigated a virtual maze to find hidden rewards. We fitted a reinforcement-learning algorithm to participants' choice behavior and evaluated the neural activity and the changes in functional connectivity related to trial-by-trial learning variables. Activity in the posterior putamen during choice periods increased progressively during learning. Furthermore, the functional connections between the sensorimotor cortex and the posterior putamen strengthened progressively as participants learned the task. These changes in corticostriatal connectivity differentiated participants who learned the task from those who did not. These findings provide a direct link between changes in corticostriatal connectivity and learning, thereby supporting a central assumption common to several computational models of reinforcement learning.
© 2014 Wiley Periodicals, Inc.

Entities:  

Keywords:  computational model-based fMRI; functional connectivity; putamen; reinforcement learning

Mesh:

Year:  2014        PMID: 25393839      PMCID: PMC4332407          DOI: 10.1002/hbm.22665

Source DB:  PubMed          Journal:  Hum Brain Mapp        ISSN: 1065-9471            Impact factor:   5.038


  47 in total

1.  Bayesian second-level analysis of functional magnetic resonance images.

Authors:  Jane Neumann; Gabriele Lohmann
Journal:  Neuroimage       Date:  2003-10       Impact factor: 6.556

2.  A virtual reality-based FMRI study of reward-based spatial learning.

Authors:  Rachel Marsh; Xuejun Hao; Dongrong Xu; Zhishun Wang; Yunsuo Duan; Jun Liu; Alayar Kangarlu; Diana Martinez; Felix Garcia; Gregory Z Tau; Shan Yu; Mark G Packard; Bradley S Peterson
Journal:  Neuropsychologia       Date:  2010-06-04       Impact factor: 3.139

3.  A triple dissociation of memory systems: hippocampus, amygdala, and dorsal striatum.

Authors:  R J McDonald; N M White
Journal:  Behav Neurosci       Date:  1993-02       Impact factor: 1.912

4.  Striatal prediction error modulates cortical coupling.

Authors:  Hanneke E M den Ouden; Jean Daunizeau; Jonathan Roiser; Karl J Friston; Klaas E Stephan
Journal:  J Neurosci       Date:  2010-03-03       Impact factor: 6.167

5.  A neostriatal habit learning system in humans.

Authors:  B J Knowlton; J A Mangels; L R Squire
Journal:  Science       Date:  1996-09-06       Impact factor: 47.728

6.  Dissociable roles of ventral and dorsal striatum in instrumental conditioning.

Authors:  John O'Doherty; Peter Dayan; Johannes Schultz; Ralf Deichmann; Karl Friston; Raymond J Dolan
Journal:  Science       Date:  2004-04-16       Impact factor: 47.728

7.  Synaptic plasticity controls sensory responses through frequency-dependent gamma oscillation resonance.

Authors:  Se-Bum Paik; Donald A Glaser
Journal:  PLoS Comput Biol       Date:  2010-09-09       Impact factor: 4.475

8.  Differential effects of fornix and caudate nucleus lesions on two radial maze tasks: evidence for multiple memory systems.

Authors:  M G Packard; R Hirsh; N M White
Journal:  J Neurosci       Date:  1989-05       Impact factor: 6.167

9.  Diffusion tensor fiber tracking shows distinct corticostriatal circuits in humans.

Authors:  Stéphane Lehéricy; Mathieu Ducros; Pierre-François Van de Moortele; Chantal Francois; Lionel Thivard; Cyril Poupon; Nick Swindale; Kamil Ugurbil; Dae-Shik Kim
Journal:  Ann Neurol       Date:  2004-04       Impact factor: 10.422

10.  A dissociation of dorso-lateral striatum and amygdala function on the same stimulus-response habit task.

Authors:  R J McDonald; N S Hong
Journal:  Neuroscience       Date:  2004       Impact factor: 3.590

View more
  16 in total

Review 1.  Evolutionary diversity as a catalyst for biological discovery.

Authors:  Zachary V Johnson; Larry J Young
Journal:  Integr Zool       Date:  2018-11       Impact factor: 2.654

Review 2.  Computational psychiatry as a bridge from neuroscience to clinical applications.

Authors:  Quentin J M Huys; Tiago V Maia; Michael J Frank
Journal:  Nat Neurosci       Date:  2016-03       Impact factor: 24.884

3.  Threat-induced modulation of hippocampal and striatal memory systems during navigation of a virtual environment.

Authors:  Jarid Goodman; Mason McClay; Joseph E Dunsmoor
Journal:  Neurobiol Learn Mem       Date:  2020-01-07       Impact factor: 2.877

4.  Reinforcement learning with associative or discriminative generalization across states and actions: fMRI at 3 T and 7 T.

Authors:  Jaron T Colas; Neil M Dundon; Raphael T Gerraty; Natalie M Saragosa-Harris; Karol P Szymula; Koranis Tanwisuth; J Michael Tyszka; Camilla van Geen; Harang Ju; Arthur W Toga; Joshua I Gold; Dani S Bassett; Catherine A Hartley; Daphna Shohamy; Scott T Grafton; John P O'Doherty
Journal:  Hum Brain Mapp       Date:  2022-07-21       Impact factor: 5.399

Review 5.  Learning, Reward, and Decision Making.

Authors:  John P O'Doherty; Jeffrey Cockburn; Wolfgang M Pauli
Journal:  Annu Rev Psychol       Date:  2016-09-28       Impact factor: 24.137

Review 6.  Why and how the brain weights contributions from a mixture of experts.

Authors:  John P O'Doherty; Sang Wan Lee; Reza Tadayonnejad; Jeff Cockburn; Kyo Iigaya; Caroline J Charpentier
Journal:  Neurosci Biobehav Rev       Date:  2021-01-11       Impact factor: 8.989

7.  Learning about Expectation Violation from Prediction Error Paradigms - A Meta-Analysis on Brain Processes Following a Prediction Error.

Authors:  Lisa D'Astolfo; Winfried Rief
Journal:  Front Psychol       Date:  2017-07-28

8.  Lenticular nucleus correlates of general self-efficacy in young adults.

Authors:  Seishu Nakagawa; Hikaru Takeuchi; Yasuyuki Taki; Rui Nouchi; Yuka Kotozaki; Takamitsu Shinada; Tsukasa Maruyama; Atsushi Sekiguchi; Kunio Iizuka; Ryoichi Yokoyama; Yuki Yamamoto; Sugiko Hanawa; Tsuyoshi Araki; Carlos Makoto Miyauchi; Daniele Magistro; Kohei Sakaki; Hyeonjeong Jeong; Yukako Sasaki; Ryuta Kawashima
Journal:  Brain Struct Funct       Date:  2017-03-28       Impact factor: 3.270

Review 9.  Auditory Hallucinations and the Brain's Resting-State Networks: Findings and Methodological Observations.

Authors:  Ben Alderson-Day; Kelly Diederen; Charles Fernyhough; Judith M Ford; Guillermo Horga; Daniel S Margulies; Simon McCarthy-Jones; Georg Northoff; James M Shine; Jessica Turner; Vincent van de Ven; Remko van Lutterveld; Flavie Waters; Renaud Jardri
Journal:  Schizophr Bull       Date:  2016-06-08       Impact factor: 9.306

Review 10.  Solving the Credit Assignment Problem With the Prefrontal Cortex.

Authors:  Alexandra Stolyarova
Journal:  Front Neurosci       Date:  2018-03-27       Impact factor: 4.677

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.