Literature DB >> 27852776

Somatic and Reinforcement-Based Plasticity in the Initial Stages of Human Motor Learning.

Ananda Sidarta1, Shahabeddin Vahdat1,2, Nicolò F Bernardi1, David J Ostry3,4.   

Abstract

As one learns to dance or play tennis, the desired somatosensory state is typically unknown. Trial and error is important as motor behavior is shaped by successful and unsuccessful movements. As an experimental model, we designed a task in which human participants make reaching movements to a hidden target and receive positive reinforcement when successful. We identified somatic and reinforcement-based sources of plasticity on the basis of changes in functional connectivity using resting-state fMRI before and after learning. The neuroimaging data revealed reinforcement-related changes in both motor and somatosensory brain areas in which a strengthening of connectivity was related to the amount of positive reinforcement during learning. Areas of prefrontal cortex were similarly altered in relation to reinforcement, with connectivity between sensorimotor areas of putamen and the reward-related ventromedial prefrontal cortex strengthened in relation to the amount of successful feedback received. In other analyses, we assessed connectivity related to changes in movement direction between trials, a type of variability that presumably reflects exploratory strategies during learning. We found that connectivity in a network linking motor and somatosensory cortices increased with trial-to-trial changes in direction. Connectivity varied as well with the change in movement direction following incorrect movements. Here the changes were observed in a somatic memory and decision making network involving ventrolateral prefrontal cortex and second somatosensory cortex. Our results point to the idea that the initial stages of motor learning are not wholly motor but rather involve plasticity in somatic and prefrontal networks related both to reward and exploration. SIGNIFICANCE STATEMENT: In the initial stages of motor learning, the placement of the limbs is learned primarily through trial and error. In an experimental analog, participants make reaching movements to a hidden target and receive positive feedback when successful. We identified sources of plasticity based on changes in functional connectivity using resting-state fMRI. The main finding is that there is a strengthening of connectivity between reward-related prefrontal areas and sensorimotor areas in the basal ganglia and frontal cortex. There is also a strengthening of connectivity related to movement exploration in sensorimotor circuits involved in somatic memory and decision making. The results indicate that initial stages of motor learning depend on plasticity in somatic and prefrontal networks related to reward and exploration.
Copyright © 2016 the authors 0270-6474/16/3611682-11$15.00/0.

Entities:  

Keywords:  reinforcement; resting-state fMRI; sensorimotor learning; somatosensory

Mesh:

Year:  2016        PMID: 27852776      PMCID: PMC5125226          DOI: 10.1523/JNEUROSCI.1767-16.2016

Source DB:  PubMed          Journal:  J Neurosci        ISSN: 0270-6474            Impact factor:   6.167


  59 in total

1.  Instructed delay activity in the human prefrontal cortex is modulated by monetary reward expectation.

Authors:  N Ramnani; R C Miall
Journal:  Cereb Cortex       Date:  2003-03       Impact factor: 5.357

2.  Neuronal correlates of decision-making in secondary somatosensory cortex.

Authors:  Ranulfo Romo; Adrián Hernández; Antonio Zainos; Luis Lemus; Carlos D Brody
Journal:  Nat Neurosci       Date:  2002-11       Impact factor: 24.884

3.  Human posterior parietal cortex flexibly determines reference frames for reaching based on sensory context.

Authors:  Pierre-Michel Bernier; Scott T Grafton
Journal:  Neuron       Date:  2010-11-18       Impact factor: 17.173

Review 4.  Advances in functional and structural MR image analysis and implementation as FSL.

Authors:  Stephen M Smith; Mark Jenkinson; Mark W Woolrich; Christian F Beckmann; Timothy E J Behrens; Heidi Johansen-Berg; Peter R Bannister; Marilena De Luca; Ivana Drobnjak; David E Flitney; Rami K Niazy; James Saunders; John Vickers; Yongyue Zhang; Nicola De Stefano; J Michael Brady; Paul M Matthews
Journal:  Neuroimage       Date:  2004       Impact factor: 6.556

5.  Dissociating valence of outcome from behavioral control in human orbital and ventral prefrontal cortices.

Authors:  John O'Doherty; Hugo Critchley; Ralf Deichmann; Raymond J Dolan
Journal:  J Neurosci       Date:  2003-08-27       Impact factor: 6.167

6.  Visual inspection of independent components: defining a procedure for artifact removal from fMRI data.

Authors:  Robert E Kelly; George S Alexopoulos; Zhishun Wang; Faith M Gunning; Christopher F Murphy; Sarah Shizuko Morimoto; Dora Kanellopoulos; Zhiru Jia; Kelvin O Lim; Matthew J Hoptman
Journal:  J Neurosci Methods       Date:  2010-04-08       Impact factor: 2.390

7.  Distinct value signals in anterior and posterior ventromedial prefrontal cortex.

Authors:  David V Smith; Benjamin Y Hayden; Trong-Kha Truong; Allen W Song; Michael L Platt; Scott A Huettel
Journal:  J Neurosci       Date:  2010-02-17       Impact factor: 6.167

8.  Adaptation to visuomotor transformations: consolidation, interference, and forgetting.

Authors:  John W Krakauer; Claude Ghez; M Felice Ghilardi
Journal:  J Neurosci       Date:  2005-01-12       Impact factor: 6.167

9.  Overcoming motor "forgetting" through reinforcement of learned actions.

Authors:  Lior Shmuelof; Vincent S Huang; Adrian M Haith; Raymond J Delnicki; Pietro Mazzoni; John W Krakauer
Journal:  J Neurosci       Date:  2012-10-17       Impact factor: 6.167

10.  Accurate and robust brain image alignment using boundary-based registration.

Authors:  Douglas N Greve; Bruce Fischl
Journal:  Neuroimage       Date:  2009-06-30       Impact factor: 6.556

View more
  15 in total

1.  Somatosensory cortical excitability changes precede those in motor cortex during human motor learning.

Authors:  Hiroki Ohashi; Paul L Gribble; David J Ostry
Journal:  J Neurophysiol       Date:  2019-08-07       Impact factor: 2.714

2.  Contribution of explicit processes to reinforcement-based motor learning.

Authors:  Peter Holland; Olivier Codol; Joseph M Galea
Journal:  J Neurophysiol       Date:  2018-03-14       Impact factor: 2.714

3.  Interactions between motor exploration and reinforcement learning.

Authors:  Shintaro Uehara; Firas Mawase; Amanda S Therrien; Kendra M Cherry-Allen; Pablo Celnik
Journal:  J Neurophysiol       Date:  2019-06-26       Impact factor: 2.714

4.  Somatosensory working memory in human reinforcement-based motor learning.

Authors:  Ananda Sidarta; Floris T van Vugt; David J Ostry
Journal:  J Neurophysiol       Date:  2018-10-24       Impact factor: 2.714

5.  Learning Similar Actions by Reinforcement or Sensory-Prediction Errors Rely on Distinct Physiological Mechanisms.

Authors:  Shintaro Uehara; Firas Mawase; Pablo Celnik
Journal:  Cereb Cortex       Date:  2018-10-01       Impact factor: 5.357

6.  Estimation of vocational aptitudes using functional brain networks.

Authors:  Yul-Wan Sung; Yousuke Kawachi; Uk-Su Choi; Daehun Kang; Chihiro Abe; Yuki Otomo; Seiji Ogawa
Journal:  Hum Brain Mapp       Date:  2018-05-01       Impact factor: 5.038

7.  The effects of error-augmentation versus error-reduction paradigms in robotic therapy to enhance upper extremity performance and recovery post-stroke: a systematic review.

Authors:  Le Yu Liu; Youlin Li; Anouk Lamontagne
Journal:  J Neuroeng Rehabil       Date:  2018-07-04       Impact factor: 4.262

8.  Multiple processes independently predict motor learning.

Authors:  Christopher M Perry; Tarkeshwar Singh; Kayla G Springer; Adam T Harrison; Alexander C McLain; Troy M Herter
Journal:  J Neuroeng Rehabil       Date:  2020-11-17       Impact factor: 4.262

9.  A robot-aided visuomotor wrist training induces gains in proprioceptive and movement accuracy in the contralateral wrist.

Authors:  Yizhao Wang; Huiying Zhu; Naveen Elangovan; Leonardo Cappello; Giulio Sandini; Lorenzo Masia; Jürgen Konczak
Journal:  Sci Rep       Date:  2021-03-05       Impact factor: 4.379

10.  Reward boosts reinforcement-based motor learning.

Authors:  Pierre Vassiliadis; Gerard Derosiere; Cecile Dubuc; Aegryan Lete; Frederic Crevecoeur; Friedhelm C Hummel; Julie Duque
Journal:  iScience       Date:  2021-07-07
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.