Literature DB >> 30354856

Somatosensory working memory in human reinforcement-based motor learning.

Ananda Sidarta1, Floris T van Vugt1,2, David J Ostry1,2.   

Abstract

Recent studies using visuomotor adaptation and sequence learning tasks have assessed the involvement of working memory in the visuospatial domain. The capacity to maintain previously performed movements in working memory is perhaps even more important in reinforcement-based learning to repeat accurate movements and avoid mistakes. Using this kind of task in the present work, we tested the relationship between somatosensory working memory and motor learning. The first experiment involved separate memory and motor learning tasks. In the memory task, the participant's arm was displaced in different directions by a robotic arm, and the participant was asked to judge whether a subsequent test direction was one of the previously presented directions. In the motor learning task, participants made reaching movements to a hidden visual target and were provided with positive feedback as reinforcement when the movement ended in the target zone. It was found that participants that had better somatosensory working memory showed greater motor learning. In a second experiment, we designed a new task in which learning and working memory trials were interleaved, allowing us to study participants' memory for movements they performed as part of learning. As in the first experiment, we found that participants with better somatosensory working memory also learned more. Moreover, memory performance for successful movements was better than for movements that failed to reach the target. These results suggest that somatosensory working memory is involved in reinforcement motor learning and that this memory preferentially keeps track of reinforced movements. NEW & NOTEWORTHY The present work examined somatosensory working memory in reinforcement-based motor learning. Working memory performance was reliably correlated with the extent of learning. With the use of a paradigm in which learning and memory trials were interleaved, memory was assessed for movements performed during learning. Movements that received positive feedback were better remembered than movements that did not. Thus working memory does not track all movements equally but is biased to retain movements that were rewarded.

Entities:  

Keywords:  exploration; reinforcement learning; sensory working memory; somatic

Mesh:

Year:  2018        PMID: 30354856      PMCID: PMC6337046          DOI: 10.1152/jn.00442.2018

Source DB:  PubMed          Journal:  J Neurophysiol        ISSN: 0022-3077            Impact factor:   2.714


  50 in total

1.  Neuronal representation of response-outcome in the primate prefrontal cortex.

Authors:  Satoshi Tsujimoto; Toshiyuki Sawaguchi
Journal:  Cereb Cortex       Date:  2004-01       Impact factor: 5.357

2.  Neuronal correlates of a perceptual decision in ventral premotor cortex.

Authors:  Ranulfo Romo; Adrián Hernández; Antonio Zainos
Journal:  Neuron       Date:  2004-01-08       Impact factor: 17.173

3.  Neuronal correlates of decision-making in secondary somatosensory cortex.

Authors:  Ranulfo Romo; Adrián Hernández; Antonio Zainos; Luis Lemus; Carlos D Brody
Journal:  Nat Neurosci       Date:  2002-11       Impact factor: 24.884

4.  The generality of working memory capacity: a latent-variable approach to verbal and visuospatial memory span and reasoning.

Authors:  Michael J Kane; David Z Hambrick; Stephen W Tuholski; Oliver Wilhelm; Tabitha W Payne; Randall W Engle
Journal:  J Exp Psychol Gen       Date:  2004-06

5.  Visuospatial working memory capacity predicts the organization of acquired explicit motor sequences.

Authors:  J Bo; R D Seidler
Journal:  J Neurophysiol       Date:  2009-04-08       Impact factor: 2.714

6.  Somatic and Reinforcement-Based Plasticity in the Initial Stages of Human Motor Learning.

Authors:  Ananda Sidarta; Shahabeddin Vahdat; Nicolò F Bernardi; David J Ostry
Journal:  J Neurosci       Date:  2016-11-16       Impact factor: 6.167

Review 7.  Neurocognitive contributions to motor skill learning: the role of working memory.

Authors:  Rachael D Seidler; Jin Bo; Joaquin A Anguera
Journal:  J Mot Behav       Date:  2012       Impact factor: 1.328

8.  Working memory capacity correlates with implicit serial reaction time task performance.

Authors:  J Bo; S Jennett; R D Seidler
Journal:  Exp Brain Res       Date:  2011-08-02       Impact factor: 1.972

9.  Reward-dependent modulation of working memory in lateral prefrontal cortex.

Authors:  Steven W Kennerley; Jonathan D Wallis
Journal:  J Neurosci       Date:  2009-03-11       Impact factor: 6.167

10.  Individual differences in explicit and implicit visuomotor learning and working memory capacity.

Authors:  Antonios I Christou; R Chris Miall; Fiona McNab; Joseph M Galea
Journal:  Sci Rep       Date:  2016-11-08       Impact factor: 4.379

View more
  10 in total

1.  Domain-Specific Working Memory, But Not Dopamine-Related Genetic Variability, Shapes Reward-Based Motor Learning.

Authors:  Peter Holland; Olivier Codol; Elizabeth Oxley; Madison Taylor; Elizabeth Hamshere; Shadiq Joseph; Laura Huffer; Joseph M Galea
Journal:  J Neurosci       Date:  2019-10-11       Impact factor: 6.167

2.  Contribution of sensory memory to speech motor learning.

Authors:  Takayuki Ito; Jiachuan Bai; David J Ostry
Journal:  J Neurophysiol       Date:  2020-09-09       Impact factor: 2.714

3.  Neural Development of Speech Sensorimotor Learning.

Authors:  Hiroki Ohashi; David J Ostry
Journal:  J Neurosci       Date:  2021-03-23       Impact factor: 6.167

4.  Reward timing matters in motor learning.

Authors:  Pierre Vassiliadis; Aegryan Lete; Julie Duque; Gerard Derosiere
Journal:  iScience       Date:  2022-04-25

5.  Clustering analysis of movement kinematics in reinforcement learning.

Authors:  Ananda Sidarta; John Komar; David J Ostry
Journal:  J Neurophysiol       Date:  2021-12-22       Impact factor: 2.714

6.  Enhanced cognitive performance after multiple adaptations to visuomotor transformations.

Authors:  Gerd Schmitz
Journal:  PLoS One       Date:  2022-09-21       Impact factor: 3.752

7.  Ventrolateral Prefrontal Cortex Contributes to Human Motor Learning.

Authors:  Neeraj Kumar; Ananda Sidarta; Chelsea Smith; David J Ostry
Journal:  eNeuro       Date:  2022-09-29

8.  Quantifying exploration in reward-based motor learning.

Authors:  Nina M van Mastrigt; Jeroen B J Smeets; Katinka van der Kooij
Journal:  PLoS One       Date:  2020-04-02       Impact factor: 3.240

9.  Reward boosts reinforcement-based motor learning.

Authors:  Pierre Vassiliadis; Gerard Derosiere; Cecile Dubuc; Aegryan Lete; Frederic Crevecoeur; Friedhelm C Hummel; Julie Duque
Journal:  iScience       Date:  2021-07-07

10.  Pitfalls in quantifying exploration in reward-based motor learning and how to avoid them.

Authors:  Nina M van Mastrigt; Katinka van der Kooij; Jeroen B J Smeets
Journal:  Biol Cybern       Date:  2021-08-02       Impact factor: 2.086

  10 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.