Literature DB >> 23455722

Neurons in the cingulate motor area signal context-based and outcome-based volitional selection of action.

Jun-ichi Iwata1, Keisetsu Shima, Jun Tanji, Hajime Mushiake.   

Abstract

Volitional selection of action is subject to continuous adjustment under the influence of information obtained by monitoring behavioral consequences and by exploiting behavioral context based on prior knowledge about the environment. The rostral cingulate motor area (CMAr) is thought to be responsible for adjusting behavior by monitoring its consequences. To investigate whether the CMAr also plays a role in exploitation of behavioral context in action selection, we recorded neuronal activities from the CMAr while monkeys performed a reward-based motor selection task that required them to switch from one action to the other based on the amount of reward. We examined both the behavior of monkeys and the activity of CMA neurons quantitatively by constructing a hybrid reinforcement learning model incorporating context-based and outcome-based action values into a new action value. We found that CMAr neurons encoded the context-based action value by increasing or decreasing their firing rates gradually with the number of repetitions of the same movement (i.e., behavioral context). We also found that CMAr neurons encoded the context-based and outcome-based action values in two distinct time windows at single neuron and population levels. Our findings indicate that the CMAr is involved in behavioral adjustment of action selection by exploiting the behavioral context and not merely by monitoring reward outcome.

Mesh:

Year:  2013        PMID: 23455722     DOI: 10.1007/s00221-013-3442-3

Source DB:  PubMed          Journal:  Exp Brain Res        ISSN: 0014-4819            Impact factor:   1.972


  43 in total

1.  Distribution of eye- and arm-movement-related neuronal activity in the SEF and in the SMA and Pre-SMA of monkeys.

Authors:  Naotaka Fujii; Hajime Mushiake; Jun Tanji
Journal:  J Neurophysiol       Date:  2002-04       Impact factor: 2.714

2.  Multiple model-based reinforcement learning.

Authors:  Kenji Doya; Kazuyuki Samejima; Ken-ichi Katagiri; Mitsuo Kawato
Journal:  Neural Comput       Date:  2002-06       Impact factor: 2.026

3.  Beyond simple reinforcement learning: the computational neurobiology of reward-learning and valuation.

Authors:  John P O'Doherty
Journal:  Eur J Neurosci       Date:  2012-04       Impact factor: 3.386

Review 4.  Functional role of the supplementary and pre-supplementary motor areas.

Authors:  Parashkev Nachev; Christopher Kennard; Masud Husain
Journal:  Nat Rev Neurosci       Date:  2008-10-09       Impact factor: 34.870

5.  Role for cingulate motor area cells in voluntary movement selection based on reward.

Authors:  K Shima; J Tanji
Journal:  Science       Date:  1998-11-13       Impact factor: 47.728

Review 6.  A neural substrate of prediction and reward.

Authors:  W Schultz; P Dayan; P R Montague
Journal:  Science       Date:  1997-03-14       Impact factor: 47.728

7.  Dissociation between conflict detection and error monitoring in the human anterior cingulate cortex.

Authors:  Diane Swick; And U Turken
Journal:  Proc Natl Acad Sci U S A       Date:  2002-11-27       Impact factor: 11.205

8.  Interactions between decision making and performance monitoring within prefrontal cortex.

Authors:  Mark E Walton; Joseph T Devlin; Matthew F S Rushworth
Journal:  Nat Neurosci       Date:  2004-10-24       Impact factor: 24.884

9.  Fictive reward signals in the anterior cingulate cortex.

Authors:  Benjamin Y Hayden; John M Pearson; Michael L Platt
Journal:  Science       Date:  2009-05-15       Impact factor: 47.728

Review 10.  Predictive reward signal of dopamine neurons.

Authors:  W Schultz
Journal:  J Neurophysiol       Date:  1998-07       Impact factor: 2.714

View more
  2 in total

1.  Stable Representations of Decision Variables for Flexible Behavior.

Authors:  Bilal A Bari; Cooper D Grossman; Emily E Lubin; Adithya E Rajagopalan; Jianna I Cressy; Jeremiah Y Cohen
Journal:  Neuron       Date:  2019-07-04       Impact factor: 17.173

Review 2.  Social learning in humans and other animals.

Authors:  Jean-François Gariépy; Karli K Watson; Emily Du; Diana L Xie; Joshua Erb; Dianna Amasino; Michael L Platt
Journal:  Front Neurosci       Date:  2014-03-31       Impact factor: 4.677

  2 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.