Literature DB >> 31015343

Reward Prediction Error Modulates Saccade Vigor.

Ehsan Sedaghat-Nejad1, David J Herzfeld2, Reza Shadmehr1.   

Abstract

Movement vigor, defined as the reciprocal of the latency from availability of reward to its acquisition, changes with reward magnitude: movements exhibit shorter reaction time and increased velocity when they are directed toward more rewarding stimuli. This invigoration may be due to release of dopamine before movement onset, which has been shown to be modulated by events that signal reward prediction error (RPE). Here, we generated an RPE event in the milliseconds before movement onset and tested whether there was a relationship between RPE and vigor. Human subjects (both sexes) made saccades toward an image. During execution of the primary saccade, we probabilistically changed the position and content of that image, encouraging a secondary saccade. On some trials, the content of the secondary image was more valuable than the first image, resulting in a positive RPE (+RPE) event that preceded the secondary saccade. On other trials, this content was less valuable (-RPE event). We found that reaction time of the secondary saccade was affected in an orderly fashion by the magnitude and direction of the preceding RPE event: the most vigorous saccades followed the largest +RPE, whereas the least vigorous saccades followed the largest -RPE. Presence of the secondary saccade indicated that the primary saccade had experienced a movement error, inducing trial-to-trial adaptation. However, this learning from movement error was not modulated by the RPE event. The data suggest that RPE events, which are thought to transiently alter the release of dopamine, modulate the vigor of the ensuing movement.SIGNIFICANCE STATEMENT Does dopamine release in response to a stimulus serve to invigorate the ensuing movement? To test this hypothesis, we relied on the fact that reward prediction error (RPE) is a strong modulator of dopamine. Our innovation was a task in which an RPE event occurred precisely before onset of a stimulus-driven movement. We probabilistically produced a combination of large or small, negative or positive RPE events and observed that saccade vigor carried a robust signature of the preceding RPE event: high vigor saccades followed +RPE events, whereas low vigor saccades followed -RPE events. This suggests that in humans, vigor is partly controlled through release of dopamine in the moments before onset of a movement.
Copyright © 2019 the authors.

Entities:  

Keywords:  dopamine; latency; motor control; reward prediction error; saccade; vigor

Mesh:

Year:  2019        PMID: 31015343      PMCID: PMC6670245          DOI: 10.1523/JNEUROSCI.0432-19.2019

Source DB:  PubMed          Journal:  J Neurosci        ISSN: 0270-6474            Impact factor:   6.167


  33 in total

1.  Expectation of reward modulates cognitive signals in the basal ganglia.

Authors:  R Kawagoe; Y Takikawa; O Hikosaka
Journal:  Nat Neurosci       Date:  1998-09       Impact factor: 24.884

2.  Beautiful faces have variable reward value: fMRI and behavioral evidence.

Authors:  I Aharon; N Etcoff; D Ariely; C F Chabris; E O'Connor; H C Breiter
Journal:  Neuron       Date:  2001-11-08       Impact factor: 17.173

3.  Beauty in a smile: the role of medial orbitofrontal cortex in facial attractiveness.

Authors:  J O'Doherty; J Winston; H Critchley; D Perrett; D M Burt; R J Dolan
Journal:  Neuropsychologia       Date:  2003       Impact factor: 3.139

4.  Midbrain dopamine neurons encode a quantitative reward prediction error signal.

Authors:  Hannah M Bayer; Paul W Glimcher
Journal:  Neuron       Date:  2005-07-07       Impact factor: 17.173

5.  Lateral habenula as a source of negative reward signals in dopamine neurons.

Authors:  Masayuki Matsumoto; Okihide Hikosaka
Journal:  Nature       Date:  2007-05-23       Impact factor: 49.962

6.  The influence of expected value on saccadic preparation.

Authors:  David M Milstein; Michael C Dorris
Journal:  J Neurosci       Date:  2007-05-02       Impact factor: 6.167

7.  Complex spike activity in the oculomotor vermis of the cerebellum: a vectorial error signal for saccade motor learning?

Authors:  Robijanto Soetedjo; Yoshiko Kojima; Albert F Fuchs
Journal:  J Neurophysiol       Date:  2008-07-23       Impact factor: 2.714

8.  Two types of dopamine neuron distinctly convey positive and negative motivational signals.

Authors:  Masayuki Matsumoto; Okihide Hikosaka
Journal:  Nature       Date:  2009-05-17       Impact factor: 49.962

9.  Changes in control of saccades during gain adaptation.

Authors:  Vincent Ethier; David S Zee; Reza Shadmehr
Journal:  J Neurosci       Date:  2008-12-17       Impact factor: 6.167

10.  Reward-predicting activity of dopamine and caudate neurons--a possible mechanism of motivational control of saccadic eye movement.

Authors:  Reiko Kawagoe; Yoriko Takikawa; Okihide Hikosaka
Journal:  J Neurophysiol       Date:  2003-10-01       Impact factor: 2.714

View more
  16 in total

1.  What Can Saccades Reveal about the Link between Learning and Motivation?

Authors:  Huw Jarvis
Journal:  J Neurosci       Date:  2019-11-20       Impact factor: 6.167

2.  Is impaired dopaminergic function associated with mobility capacity in older adults?

Authors:  Simon Moskowitz; David W Russ; Leatha A Clark; Nathan P Wages; Dustin R Grooms; Adam J Woods; Julie Suhr; Janet E Simon; Andrew O'Shea; Cody R Criss; Paolo Fadda; Brian C Clark
Journal:  Geroscience       Date:  2020-11-24       Impact factor: 7.713

3.  Effort reinforces learning.

Authors:  Huw Jarvis; Isabelle Stevenson; Amy Q Huynh; Emily Babbage; James Coxon; Trevor T-J Chong
Journal:  J Neurosci       Date:  2022-09-06       Impact factor: 6.709

4.  Behavioral training of marmosets and electrophysiological recording from the cerebellum.

Authors:  Ehsan Sedaghat-Nejad; David J Herzfeld; Paul Hage; Kaveh Karbasi; Tara Palin; Xiaoqin Wang; Reza Shadmehr
Journal:  J Neurophysiol       Date:  2019-08-07       Impact factor: 2.714

5.  Saccade vigor and the subjective economic value of visual stimuli.

Authors:  Tehrim Yoon; Afareen Jaleel; Alaa A Ahmed; Reza Shadmehr
Journal:  J Neurophysiol       Date:  2020-05-06       Impact factor: 2.714

6.  The cost of correcting for error during sensorimotor adaptation.

Authors:  Ehsan Sedaghat-Nejad; Reza Shadmehr
Journal:  Proc Natl Acad Sci U S A       Date:  2021-10-05       Impact factor: 12.779

7.  The aversion positivity: Mediofrontal cortical potentials reflect parametric aversive prediction errors and drive behavioral modification following negative reinforcement.

Authors:  Eric Rawls; Connie Lamm
Journal:  Cortex       Date:  2021-03-27       Impact factor: 4.644

8.  How the value of the environment controls persistence in visual search.

Authors:  Michael R Traner; Ethan S Bromberg-Martin; Ilya E Monosov
Journal:  PLoS Comput Biol       Date:  2021-12-14       Impact factor: 4.475

9.  Long-Term Motor Learning in the "Wild" With High Volume Video Game Data.

Authors:  Jennifer B Listman; Jonathan S Tsay; Hyosub E Kim; Wayne E Mackey; David J Heeger
Journal:  Front Hum Neurosci       Date:  2021-12-20       Impact factor: 3.169

10.  The Aging Brain & the Dorsal Basal Ganglia: Implications for Age-Related Limitations of Mobility.

Authors:  Brian C Clark; Adam J Woods; Leatha A Clark; Cody R Criss; Reza Shadmehr; Dustin R Grooms
Journal:  Adv Geriatr Med Res       Date:  2019-08-16
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.