Literature DB >> 23077047

Overcoming motor "forgetting" through reinforcement of learned actions.

Lior Shmuelof1, Vincent S Huang, Adrian M Haith, Raymond J Delnicki, Pietro Mazzoni, John W Krakauer.   

Abstract

The human motor system rapidly adapts to systematic perturbations but the adapted behavior seems to be forgotten equally rapidly. The reason for this forgetting is unclear, as is how to overcome it to promote long-term learning. Here we show that adapted behavior can be stabilized by a period of binary feedback about success and failure in the absence of vector error feedback. We examined the time course of decay after adaptation to a visuomotor rotation through a visual error-clamp condition--trials in which subjects received false visual feedback showing perfect directional performance, regardless of the movements they actually made. Exposure to this error-clamp following initial visuomotor adaptation led to a rapid reversion to baseline behavior. In contrast, exposure to binary feedback after initial adaptation turned the adapted state into a new baseline, to which subjects reverted after transient exposure to another visuomotor rotation. When both binary feedback and vector error were present, some subjects exhibited rapid decay to the original baseline, while others persisted in the new baseline. We propose that learning can be decomposed into two components--a fast-learning, fast-forgetting adaptation process that is sensitive to vector errors and insensitive to task success, and a second process driven by success that learns more slowly but is less susceptible to forgetting. These two learning systems may be recruited to different degrees across individuals. Understanding this competitive balance and exploiting the long-term retention properties of learning through reinforcement is likely to be essential for successful neuro-rehabilitation.

Entities:  

Mesh:

Year:  2012        PMID: 23077047      PMCID: PMC3525880          DOI: 10.1523/JNEUROSCI.2184-12.2012

Source DB:  PubMed          Journal:  J Neurosci        ISSN: 0270-6474            Impact factor:   6.167


  27 in total

1.  Independent learning of internal models for kinematic and dynamic control of reaching.

Authors:  J W Krakauer; M F Ghilardi; C Ghez
Journal:  Nat Neurosci       Date:  1999-11       Impact factor: 24.884

2.  Persistence of motor adaptation during constrained, multi-joint, arm movements.

Authors:  R A Scheidt; D J Reinkensmeyer; M A Conditt; W Z Rymer; F A Mussa-Ivaldi
Journal:  J Neurophysiol       Date:  2000-08       Impact factor: 2.714

3.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control.

Authors:  Nathaniel D Daw; Yael Niv; Peter Dayan
Journal:  Nat Neurosci       Date:  2005-11-06       Impact factor: 24.884

4.  An implicit plan overrides an explicit strategy during visuomotor adaptation.

Authors:  Pietro Mazzoni; John W Krakauer
Journal:  J Neurosci       Date:  2006-04-05       Impact factor: 6.167

5.  Calibration of visually guided reaching is driven by error-corrective learning and internal dynamics.

Authors:  Sen Cheng; Philip N Sabes
Journal:  J Neurophysiol       Date:  2007-01-03       Impact factor: 2.714

6.  Cerebellar contributions to reach adaptation and learning sensory consequences of action.

Authors:  Jun Izawa; Sarah E Criscimagna-Hemminger; Reza Shadmehr
Journal:  J Neurosci       Date:  2012-03-21       Impact factor: 6.167

7.  Adaptive representation of dynamics during learning of a motor task.

Authors:  R Shadmehr; F A Mussa-Ivaldi
Journal:  J Neurosci       Date:  1994-05       Impact factor: 6.167

8.  Evaluation of robotic training forces that either enhance or reduce error in chronic hemiparetic stroke survivors.

Authors:  James L Patton; Mary Ellen Stoykov; Mark Kovic; Ferdinando A Mussa-Ivaldi
Journal:  Exp Brain Res       Date:  2005-10-26       Impact factor: 1.972

9.  Hereditary cerebellar ataxia progressively impairs force adaptation during goal-directed arm movements.

Authors:  Matthias Maschke; Christopher M Gomez; Timothy J Ebner; Jürgen Konczak
Journal:  J Neurophysiol       Date:  2003-09-17       Impact factor: 2.714

10.  Interacting adaptive processes with different timescales underlie short-term motor learning.

Authors:  Maurice A Smith; Ali Ghazizadeh; Reza Shadmehr
Journal:  PLoS Biol       Date:  2006-05-23       Impact factor: 8.029

View more
  80 in total

1.  How the required precision influences the way we intercept a moving object.

Authors:  Eli Brenner; Rouwen Cañal-Bruland; Robert J van Beers
Journal:  Exp Brain Res       Date:  2013-07-16       Impact factor: 1.972

2.  Characteristics of Implicit Sensorimotor Adaptation Revealed by Task-irrelevant Clamped Feedback.

Authors:  J Ryan Morehead; Jordan A Taylor; Darius E Parvin; Richard B Ivry
Journal:  J Cogn Neurosci       Date:  2017-02-14       Impact factor: 3.225

3.  Performing a reaching task with one arm while adapting to a visuomotor rotation with the other can lead to complete transfer of motor learning across the arms.

Authors:  Jinsung Wang; Yuming Lei; Jeffrey R Binder
Journal:  J Neurophysiol       Date:  2015-01-28       Impact factor: 2.714

4.  Formation of model-free motor memories during motor adaptation depends on perturbation schedule.

Authors:  Jean-Jacques Orban de Xivry; Philippe Lefèvre
Journal:  J Neurophysiol       Date:  2015-02-11       Impact factor: 2.714

5.  Distinct types of neural reorganization during long-term learning.

Authors:  Xiao Zhou; Rex N Tien; Sadhana Ravikumar; Steven M Chase
Journal:  J Neurophysiol       Date:  2019-02-06       Impact factor: 2.714

6.  Motor Learning Enhances Use-Dependent Plasticity.

Authors:  Firas Mawase; Shintaro Uehara; Amy J Bastian; Pablo Celnik
Journal:  J Neurosci       Date:  2017-01-31       Impact factor: 6.167

7.  It's Not (Only) the Mean that Matters: Variability, Noise and Exploration in Skill Learning.

Authors:  Dagmar Sternad
Journal:  Curr Opin Behav Sci       Date:  2018-03-01

8.  Explicit and implicit contributions to learning in a sensorimotor adaptation task.

Authors:  Jordan A Taylor; John W Krakauer; Richard B Ivry
Journal:  J Neurosci       Date:  2014-02-19       Impact factor: 6.167

Review 9.  The role of neuroplasticity in dopaminergic therapy for Parkinson disease.

Authors:  Xiaoxi Zhuang; Pietro Mazzoni; Un Jung Kang
Journal:  Nat Rev Neurol       Date:  2013-04-16       Impact factor: 42.937

10.  Somatosensory working memory in human reinforcement-based motor learning.

Authors:  Ananda Sidarta; Floris T van Vugt; David J Ostry
Journal:  J Neurophysiol       Date:  2018-10-24       Impact factor: 2.714

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.