Literature DB >> 15210973

The loss function of sensorimotor learning.

Konrad Paul Körding1, Daniel M Wolpert.   

Abstract

Motor learning can be defined as changing performance so as to optimize some function of the task, such as accuracy. The measure of accuracy that is optimized is called a loss function and specifies how the CNS rates the relative success or cost of a particular movement outcome. Models of pointing in sensorimotor control and learning usually assume a quadratic loss function in which the mean squared error is minimized. Here we develop a technique for measuring the loss associated with errors. Subjects were required to perform a task while we experimentally controlled the skewness of the distribution of errors they experienced. Based on the change in the subjects' average performance, we infer the loss function. We show that people use a loss function in which the cost increases approximately quadratically with error for small errors and significantly less than quadratically for large errors. The system is thus robust to outliers. This suggests that models of sensorimotor control and learning that have assumed minimizing squared error are a good approximation but tend to penalize large errors excessively.

Entities:  

Mesh:

Year:  2004        PMID: 15210973      PMCID: PMC470761          DOI: 10.1073/pnas.0308394101

Source DB:  PubMed          Journal:  Proc Natl Acad Sci U S A        ISSN: 0027-8424            Impact factor:   11.205


  15 in total

1.  Learning to move amid uncertainty.

Authors:  R A Scheidt; J B Dingwell; F A Mussa-Ivaldi
Journal:  J Neurophysiol       Date:  2001-08       Impact factor: 2.714

2.  Virtual muscle: a computational approach to understanding the effects of muscle properties on motor control.

Authors:  E J Cheng; I E Brown; G E Loeb
Journal:  J Neurosci Methods       Date:  2000-09-15       Impact factor: 2.390

3.  Optimal feedback control as a theory of motor coordination.

Authors:  Emanuel Todorov; Michael I Jordan
Journal:  Nat Neurosci       Date:  2002-11       Impact factor: 24.884

4.  Bayesian integration in sensorimotor learning.

Authors:  Konrad P Körding; Daniel M Wolpert
Journal:  Nature       Date:  2004-01-15       Impact factor: 49.962

5.  Statistical decision theory and the selection of rapid, goal-directed movements.

Authors:  Julia Trommershäuser; Laurence T Maloney; Michael S Landy
Journal:  J Opt Soc Am A Opt Image Sci Vis       Date:  2003-07       Impact factor: 2.129

6.  Quantifying generalization from trial-by-trial behavior of adaptive systems that learn with basis functions: theory and experiments in human motor control.

Authors:  Opher Donchin; Joseph T Francis; Reza Shadmehr
Journal:  J Neurosci       Date:  2003-10-08       Impact factor: 6.167

7.  Signal-dependent noise determines motor planning.

Authors:  C M Harris; D M Wolpert
Journal:  Nature       Date:  1998-08-20       Impact factor: 49.962

8.  Perceptual and conceptual factors in distortions in memory for graphs and maps.

Authors:  B Tversky; D J Schiano
Journal:  J Exp Psychol Gen       Date:  1989-12

9.  Formation and control of optimal trajectory in human multijoint arm movement. Minimum torque-change model.

Authors:  Y Uno; M Kawato; R Suzuki
Journal:  Biol Cybern       Date:  1989       Impact factor: 2.086

10.  The coordination of arm movements: an experimentally confirmed mathematical model.

Authors:  T Flash; N Hogan
Journal:  J Neurosci       Date:  1985-07       Impact factor: 6.167

View more
  69 in total

Review 1.  Optimality principles in sensorimotor control.

Authors:  Emanuel Todorov
Journal:  Nat Neurosci       Date:  2004-09       Impact factor: 24.884

2.  Natural error patterns enable transfer of motor learning to novel contexts.

Authors:  Gelsy Torres-Oviedo; Amy J Bastian
Journal:  J Neurophysiol       Date:  2011-09-28       Impact factor: 2.714

Review 3.  Motor control is decision-making.

Authors:  Daniel M Wolpert; Michael S Landy
Journal:  Curr Opin Neurobiol       Date:  2012-05-29       Impact factor: 6.627

4.  Sensitivity to prediction error in reach adaptation.

Authors:  Mollie K Marko; Adrian M Haith; Michelle D Harran; Reza Shadmehr
Journal:  J Neurophysiol       Date:  2012-07-05       Impact factor: 2.714

5.  A Bayesian observer model constrained by efficient coding can explain 'anti-Bayesian' percepts.

Authors:  Xue-Xin Wei; Alan A Stocker
Journal:  Nat Neurosci       Date:  2015-09-07       Impact factor: 24.884

6.  Stochastic optimal control and estimation methods adapted to the noise characteristics of the sensorimotor system.

Authors:  Emanuel Todorov
Journal:  Neural Comput       Date:  2005-05       Impact factor: 2.026

Review 7.  Computational principles of sensorimotor control that minimize uncertainty and variability.

Authors:  Paul M Bays; Daniel M Wolpert
Journal:  J Physiol       Date:  2006-09-28       Impact factor: 5.182

8.  Combining priors and noisy visual cues in a rapid pointing task.

Authors:  Hadley Tassinari; Todd E Hudson; Michael S Landy
Journal:  J Neurosci       Date:  2006-10-04       Impact factor: 6.167

9.  Error-driven learning in statistical summary perception.

Authors:  Judith E Fan; Nicholas B Turk-Browne; Jordan A Taylor
Journal:  J Exp Psychol Hum Percept Perform       Date:  2015-09-21       Impact factor: 3.332

10.  Multisensory oddity detection as bayesian inference.

Authors:  Timothy Hospedales; Sethu Vijayakumar
Journal:  PLoS One       Date:  2009-01-15       Impact factor: 3.240

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.