Literature DB >> 35975792

Value representations in the rodent orbitofrontal cortex drive learning, not choice.

Kevin J Miller1,2,3, Matthew M Botvinick2,4, Carlos D Brody1,5.   

Abstract

Humans and animals make predictions about the rewards they expect to receive in different situations. In formal models of behavior, these predictions are known as value representations, and they play two very different roles. Firstly, they drive choice: the expected values of available options are compared to one another, and the best option is selected. Secondly, they support learning: expected values are compared to rewards actually received, and future expectations are updated accordingly. Whether these different functions are mediated by different neural representations remains an open question. Here, we employ a recently developed multi-step task for rats that computationally separates learning from choosing. We investigate the role of value representations in the rodent orbitofrontal cortex, a key structure for value-based cognition. Electrophysiological recordings and optogenetic perturbations indicate that these representations do not directly drive choice. Instead, they signal expected reward information to a learning process elsewhere in the brain that updates choice mechanisms.
© 2022, Miller et al.

Entities:  

Keywords:  decision making; electrophysiology; learning; neuroscience; orbitofrontal cortex; planning; rat; reinforcement learning

Mesh:

Year:  2022        PMID: 35975792      PMCID: PMC9462853          DOI: 10.7554/eLife.64575

Source DB:  PubMed          Journal:  Elife        ISSN: 2050-084X            Impact factor:   8.713


  74 in total

1.  Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex.

Authors:  M P Noonan; M E Walton; T E J Behrens; J Sallet; M J Buckley; M F S Rushworth
Journal:  Proc Natl Acad Sci U S A       Date:  2010-11-08       Impact factor: 11.205

2.  Contrasting Effects of Medial and Lateral Orbitofrontal Cortex Lesions on Credit Assignment and Decision-Making in Humans.

Authors:  MaryAnn P Noonan; Bolton K H Chau; Matthew F S Rushworth; Lesley K Fellows
Journal:  J Neurosci       Date:  2017-06-19       Impact factor: 6.167

3.  Neurons in the orbitofrontal cortex encode economic value.

Authors:  Camillo Padoa-Schioppa; John A Assad
Journal:  Nature       Date:  2006-04-23       Impact factor: 49.962

4.  Heterogeneous coding of temporally discounted values in the dorsal and ventral striatum during intertemporal choice.

Authors:  Xinying Cai; Soyoun Kim; Daeyeol Lee
Journal:  Neuron       Date:  2011-01-13       Impact factor: 17.173

Review 5.  The orbitofrontal oracle: cortical mechanisms for the prediction and evaluation of specific behavioral outcomes.

Authors:  Peter H Rudebeck; Elisabeth A Murray
Journal:  Neuron       Date:  2014-12-17       Impact factor: 17.173

Review 6.  A new perspective on the role of the orbitofrontal cortex in adaptive behaviour.

Authors:  Geoffrey Schoenbaum; Matthew R Roesch; Thomas A Stalnaker; Yuji K Takahashi
Journal:  Nat Rev Neurosci       Date:  2009-11-11       Impact factor: 34.870

7.  Orbitofrontal cortex as a cognitive map of task space.

Authors:  G Schoenbaum; Yael Niv; Robert C Wilson; Yuji K Takahashi
Journal:  Neuron       Date:  2014-01-22       Impact factor: 17.173

8.  Encoding predictive reward value in human amygdala and orbitofrontal cortex.

Authors:  Jay A Gottfried; John O'Doherty; Raymond J Dolan
Journal:  Science       Date:  2003-08-22       Impact factor: 47.728

9.  Specialized areas for value updating and goal selection in the primate orbitofrontal cortex.

Authors:  Elisabeth A Murray; Emily J Moylan; Kadharbatcha S Saleem; Benjamin M Basile; Janita Turchi
Journal:  Elife       Date:  2015-12-17       Impact factor: 8.140

10.  Neural mechanisms of economic choices in mice.

Authors:  Masaru Kuwabara; Ningdong Kang; Timothy E Holy; Camillo Padoa-Schioppa
Journal:  Elife       Date:  2020-02-25       Impact factor: 8.140

View more
  2 in total

1.  Value representations in the rodent orbitofrontal cortex drive learning, not choice.

Authors:  Kevin J Miller; Matthew M Botvinick; Carlos D Brody
Journal:  Elife       Date:  2022-08-17       Impact factor: 8.713

Review 2.  Amygdala-cortical collaboration in reward learning and decision making.

Authors:  Kate M Wassum
Journal:  Elife       Date:  2022-09-05       Impact factor: 8.713

  2 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.