Literature DB >> 31630947

Adaptive Regulation of Motor Variability.

Ashesh K Dhawale1, Yohsuke R Miyamoto2, Maurice A Smith2, Bence P Ölveczky3.   

Abstract

Trial-to-trial movement variability can both drive motor learning and interfere with expert performance, suggesting benefits of regulating it in context-specific ways. Here we address whether and how the brain regulates motor variability as a function of performance by training rats to execute ballistic forelimb movements for reward. Behavioral datasets comprising millions of trials revealed that motor variability is regulated by two distinct processes. A fast process modulates variability as a function of recent trial outcomes, increasing it when performance is poor and vice versa. A slower process tunes the gain of the fast process based on the uncertainty in the task's reward landscape. Simulations demonstrated that this regulation strategy optimizes reward accumulation over a wide range of time horizons, while also promoting learning. Our results uncover a sophisticated algorithm implemented by the brain to adaptively regulate motor variability to improve task performance. VIDEO ABSTRACT.
Copyright © 2019 Elsevier Ltd. All rights reserved.

Entities:  

Keywords:  motor control; motor learning; rat; reinforcement learning; uncertainty; variability

Year:  2019        PMID: 31630947      PMCID: PMC7339968          DOI: 10.1016/j.cub.2019.08.052

Source DB:  PubMed          Journal:  Curr Biol        ISSN: 0960-9822            Impact factor:   10.834


  51 in total

Review 1.  What songbirds teach us about learning.

Authors:  Michael S Brainard; Allison J Doupe
Journal:  Nature       Date:  2002-05-16       Impact factor: 49.962

Review 2.  Control of exploitation-exploration meta-parameter in reinforcement learning.

Authors:  Shin Ishii; Wako Yoshida; Junichiro Yoshimoto
Journal:  Neural Netw       Date:  2002 Jun-Jul

3.  Optimal feedback control as a theory of motor coordination.

Authors:  Emanuel Todorov; Michael I Jordan
Journal:  Nat Neurosci       Date:  2002-11       Impact factor: 24.884

4.  Temporal structure of motor variability is dynamically regulated and predicts motor learning ability.

Authors:  Howard G Wu; Yohsuke R Miyamoto; Luis Nicolas Gonzalez Castro; Bence P Ölveczky; Maurice A Smith
Journal:  Nat Neurosci       Date:  2014-01-12       Impact factor: 24.884

5.  Reward-dependent modulation of movement variability.

Authors:  Sarah E Pekny; Jun Izawa; Reza Shadmehr
Journal:  J Neurosci       Date:  2015-03-04       Impact factor: 6.167

6.  Cortical substrates for exploratory decisions in humans.

Authors:  Nathaniel D Daw; John P O'Doherty; Peter Dayan; Ben Seymour; Raymond J Dolan
Journal:  Nature       Date:  2006-06-15       Impact factor: 49.962

7.  It's Not (Only) the Mean that Matters: Variability, Noise and Exploration in Skill Learning.

Authors:  Dagmar Sternad
Journal:  Curr Opin Behav Sci       Date:  2018-03-01

Review 8.  Learned birdsong and the neurobiology of human language.

Authors:  Erich D Jarvis
Journal:  Ann N Y Acad Sci       Date:  2004-06       Impact factor: 5.691

9.  Learning substrates in the primate prefrontal cortex and striatum: sustained activity related to successful actions.

Authors:  Mark H Histed; Anitha Pasupathy; Earl K Miller
Journal:  Neuron       Date:  2009-07-30       Impact factor: 17.173

10.  Social context-induced song variation affects female behavior and gene expression.

Authors:  Sarah C Woolley; Allison J Doupe
Journal:  PLoS Biol       Date:  2008-03-18       Impact factor: 8.029

View more
  13 in total

1.  Reinforcement regulates timing variability in thalamus.

Authors:  Jing Wang; Eghbal Hosseini; Nicolas Meirhaeghe; Adam Akkad; Mehrdad Jazayeri
Journal:  Elife       Date:  2020-12-01       Impact factor: 8.140

2.  Impaired Refinement of Kinematic Variability in Huntington Disease Mice on an Automated Home Cage Forelimb Motor Task.

Authors:  Cameron L Woodard; Marja D Sepers; Lynn A Raymond
Journal:  J Neurosci       Date:  2021-08-24       Impact factor: 6.167

3.  Sensorimotor Cortex GABA Moderates the Relationship between Physical Exertion and Assessments of Effort.

Authors:  Eric J Hu; Agostina Casamento-Moran; Joseph K Galaro; Kimberly L Chan; Richard A E Edden; Nicolaas A J Puts; Vikram S Chib
Journal:  J Neurosci       Date:  2022-06-28       Impact factor: 6.709

4.  Online control of reach accuracy in mice.

Authors:  Matthew I Becker; Dylan J Calame; Julia Wrobel; Abigail L Person
Journal:  J Neurophysiol       Date:  2020-09-30       Impact factor: 2.714

5.  Cortico-striatal circuits for bilaterally coordinated movements.

Authors:  Ana K Pimentel-Farfan; Ana S Báez-Cordero; Teresa M Peña-Rangel; Pavel E Rueda-Orozco
Journal:  Sci Adv       Date:  2022-03-04       Impact factor: 14.136

6.  Rodents monitor their error in self-generated duration on a single trial basis.

Authors:  Tadeusz Władysław Kononowicz; Virginie van Wassenhove; Valérie Doyère
Journal:  Proc Natl Acad Sci U S A       Date:  2022-03-01       Impact factor: 12.779

7.  Quantifying exploration in reward-based motor learning.

Authors:  Nina M van Mastrigt; Jeroen B J Smeets; Katinka van der Kooij
Journal:  PLoS One       Date:  2020-04-02       Impact factor: 3.240

8.  Providing Task Instructions During Motor Training Enhances Performance and Modulates Attentional Brain Networks.

Authors:  Joaquin Penalver-Andres; Karin A Buetler; Thomas Koenig; René Martin Müri; Laura Marchal-Crespo
Journal:  Front Neurosci       Date:  2021-12-09       Impact factor: 4.677

9.  Variable rather than extreme slow reaction times distinguish brain states during sustained attention.

Authors:  Ayumu Yamashita; David Rothlein; Aaron Kucyi; Eve M Valera; Laura Germine; Jeremy Wilmer; Joseph DeGutis; Michael Esterman
Journal:  Sci Rep       Date:  2021-07-21       Impact factor: 4.379

10.  Pitfalls in quantifying exploration in reward-based motor learning and how to avoid them.

Authors:  Nina M van Mastrigt; Katinka van der Kooij; Jeroen B J Smeets
Journal:  Biol Cybern       Date:  2021-08-02       Impact factor: 2.086

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.