Literature DB >> 29537911

Vigor of reaching movements: reward discounts the cost of effort.

Erik M Summerside1, Reza Shadmehr2, Alaa A Ahmed1.   

Abstract

Making a movement may be thought of as an economic decision in which one spends effort to acquire reward. Time discounts reward, which predicts that the magnitude of reward should affect movement vigor: we should move faster, spending greater effort, when there is greater reward at stake. Indeed, saccade peak velocities are greater and reaction-times shorter when a target is paired with reward. In this study, we focused on human reaching and asked whether movement kinematics were affected by expectation of reward. Participants made out-and-back reaching movements to one of four quadrants of a 14-cm circle. During various periods of the experiment only one of the four quadrants was paired with reward, and the transition from reward to nonreward status of a quadrant occurred randomly. Our experiment design minimized dependence of reward on accuracy, granting the subjects wide latitude in self-selecting their movement speed, amplitude, and variability. When a quadrant was paired with reward, reaching movements had a shorter reaction time, higher peak velocity, and greater amplitude. Despite this greater vigor, movements toward the rewarded quadrant suffered from less variability: both reaction times and reach kinematics were less variable when there was expectation of reward. Importantly, the effect of reward on vigor was specific to the movement component that preceded the time of reward (outward reach), not the movement component that followed it (return reach). Our results suggest that expectation of reward not only increases vigor of human reaching but also decreases its variability. NEW & NOTEWORTHY Movements may be thought of as an economic transaction where the vigor of the movement represents the effort that the brain is willing to expend to acquire a rewarding state. We show that in reaching, reward discounts the cost of effort, producing movements with shorter reaction time, higher velocity, greater amplitude, and reduced reaction-time variability. These results complement earlier observations in saccades, suggesting a common principle of economics across modalities of motor control.

Entities:  

Keywords:  effort; reaching movements; reward; variability; vigor

Mesh:

Year:  2018        PMID: 29537911      PMCID: PMC6734091          DOI: 10.1152/jn.00872.2017

Source DB:  PubMed          Journal:  J Neurophysiol        ISSN: 0022-3077            Impact factor:   2.714


  52 in total

1.  To walk or to fly? How birds choose among foraging modes.

Authors:  L M Bautista; J Tinbergen; A Kacelnik
Journal:  Proc Natl Acad Sci U S A       Date:  2001-01-30       Impact factor: 11.205

2.  Expectation of reward modulates cognitive signals in the basal ganglia.

Authors:  R Kawagoe; Y Takikawa; O Hikosaka
Journal:  Nat Neurosci       Date:  1998-09       Impact factor: 24.884

3.  Modulation of saccadic eye movements by predicted reward outcome.

Authors:  Yoriko Takikawa; Reiko Kawagoe; Hideaki Itoh; Hiroyuki Nakahara; Okihide Hikosaka
Journal:  Exp Brain Res       Date:  2001-11-28       Impact factor: 1.972

4.  The role of execution noise in movement variability.

Authors:  Robert J van Beers; Patrick Haggard; Daniel M Wolpert
Journal:  J Neurophysiol       Date:  2003-10-15       Impact factor: 2.714

5.  Neuron-specific contribution of the superior colliculus to overt and covert shifts of attention.

Authors:  Alla Ignashchenkova; Peter W Dicke; Thomas Haarmeier; Peter Thier
Journal:  Nat Neurosci       Date:  2003-12-21       Impact factor: 24.884

6.  Contiguity and contingency in action-effect learning.

Authors:  Birgit Elsner; Bernhard Hommel
Journal:  Psychol Res       Date:  2003-12-18

7.  Statistical decision theory and the selection of rapid, goal-directed movements.

Authors:  Julia Trommershäuser; Laurence T Maloney; Michael S Landy
Journal:  J Opt Soc Am A Opt Image Sci Vis       Date:  2003-07       Impact factor: 2.129

8.  Reward-dependent gain and bias of visual responses in primate superior colliculus.

Authors:  Takuro Ikeda; Okihide Hikosaka
Journal:  Neuron       Date:  2003-08-14       Impact factor: 17.173

9.  The central nervous system stabilizes unstable dynamics by learning optimal impedance.

Authors:  E Burdet; R Osu; D W Franklin; T E Milner; M Kawato
Journal:  Nature       Date:  2001-11-22       Impact factor: 49.962

10.  Intact ability to learn internal models of arm dynamics in Huntington's disease but not cerebellar degeneration.

Authors:  Maurice A Smith; Reza Shadmehr
Journal:  J Neurophysiol       Date:  2004-12-29       Impact factor: 2.714

View more
  32 in total

1.  Motor cortex disruption delays motor processes but not deliberation about action choices.

Authors:  Gerard Derosiere; David Thura; Paul Cisek; Julie Duque
Journal:  J Neurophysiol       Date:  2019-08-14       Impact factor: 2.714

2.  Control of movement vigor and decision making during foraging.

Authors:  Tehrim Yoon; Robert B Geary; Alaa A Ahmed; Reza Shadmehr
Journal:  Proc Natl Acad Sci U S A       Date:  2018-10-15       Impact factor: 11.205

3.  Luring the Motor System: Impact of Performance-Contingent Incentives on Pre-Movement Beta-Band Activity and Motor Performance.

Authors:  Félix-Antoine Savoie; Raphaël Hamel; Angélina Lacroix; François Thénault; Kevin Whittingstall; Pierre-Michel Bernier
Journal:  J Neurosci       Date:  2019-02-08       Impact factor: 6.167

4.  Acetylcholine acts on songbird premotor circuitry to invigorate vocal output.

Authors:  Paul I Jaffe; Michael S Brainard
Journal:  Elife       Date:  2020-05-19       Impact factor: 8.140

5.  Reward-Based Improvements in Motor Control Are Driven by Multiple Error-Reducing Mechanisms.

Authors:  Olivier Codol; Peter J Holland; Sanjay G Manohar; Joseph M Galea
Journal:  J Neurosci       Date:  2020-03-31       Impact factor: 6.167

6.  What Can Saccades Reveal about the Link between Learning and Motivation?

Authors:  Huw Jarvis
Journal:  J Neurosci       Date:  2019-11-20       Impact factor: 6.167

7.  The influence of task outcome on implicit motor learning.

Authors:  Hyosub E Kim; Darius E Parvin; Richard B Ivry
Journal:  Elife       Date:  2019-04-29       Impact factor: 8.140

8.  Contributions of metabolic and temporal costs to human gait selection.

Authors:  Erik M Summerside; Rodger Kram; Alaa A Ahmed
Journal:  J R Soc Interface       Date:  2018-06       Impact factor: 4.118

Review 9.  Movement Vigor as a Reflection of Subjective Economic Utility.

Authors:  Reza Shadmehr; Thomas R Reppert; Erik M Summerside; Tehrim Yoon; Alaa A Ahmed
Journal:  Trends Neurosci       Date:  2019-03-13       Impact factor: 13.837

10.  Movement vigor as a traitlike attribute of individuality.

Authors:  Thomas R Reppert; Ioannis Rigas; David J Herzfeld; Ehsan Sedaghat-Nejad; Oleg Komogortsev; Reza Shadmehr
Journal:  J Neurophysiol       Date:  2018-05-16       Impact factor: 2.714

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.