Literature DB >> 22462543

Neural basis of reinforcement learning and decision making.

Daeyeol Lee1, Hyojung Seo, Min Whan Jung.   

Abstract

Reinforcement learning is an adaptive process in which an animal utilizes its previous experience to improve the outcomes of future choices. Computational theories of reinforcement learning play a central role in the newly emerging areas of neuroeconomics and decision neuroscience. In this framework, actions are chosen according to their value functions, which describe how much future reward is expected from each action. Value functions can be adjusted not only through reward and penalty, but also by the animal's knowledge of its current environment. Studies have revealed that a large proportion of the brain is involved in representing and updating value functions and using them to choose an action. However, how the nature of a behavioral task affects the neural mechanisms of reinforcement learning remains incompletely understood. Future studies should uncover the principles by which different computational elements of reinforcement learning are dynamically coordinated across the entire brain.

Entities:  

Mesh:

Year:  2012        PMID: 22462543      PMCID: PMC3490621          DOI: 10.1146/annurev-neuro-062111-150512

Source DB:  PubMed          Journal:  Annu Rev Neurosci        ISSN: 0147-006X            Impact factor:   12.449


  134 in total

Review 1.  Synaptic reverberation underlying mnemonic persistent activity.

Authors:  X J Wang
Journal:  Trends Neurosci       Date:  2001-08       Impact factor: 13.837

2.  Matching behavior and the representation of value in the parietal cortex.

Authors:  Leo P Sugrue; Greg S Corrado; William T Newsome
Journal:  Science       Date:  2004-06-18       Impact factor: 47.728

3.  Cortico-basal ganglia circuit mechanism for a decision threshold in reaction time tasks.

Authors:  Chung-Chuan Lo; Xiao-Jing Wang
Journal:  Nat Neurosci       Date:  2006-06-11       Impact factor: 24.884

4.  Neural variability in premotor cortex provides a signature of motor preparation.

Authors:  Mark M Churchland; Byron M Yu; Stephen I Ryu; Gopal Santhanam; Krishna V Shenoy
Journal:  J Neurosci       Date:  2006-04-05       Impact factor: 6.167

5.  Distinct roles of rodent orbitofrontal and medial prefrontal cortex in decision making.

Authors:  Jung Hoon Sul; Hoseok Kim; Namjung Huh; Daeyeol Lee; Min Whan Jung
Journal:  Neuron       Date:  2010-05-13       Impact factor: 17.173

Review 6.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates.

Authors:  B W Balleine; A Dickinson
Journal:  Neuropharmacology       Date:  1998 Apr-May       Impact factor: 5.250

7.  Primate frontal eye fields. I. Single neurons discharging before saccades.

Authors:  C J Bruce; M E Goldberg
Journal:  J Neurophysiol       Date:  1985-03       Impact factor: 2.714

Review 8.  Neurobiology of economic choice: a good-based model.

Authors:  Camillo Padoa-Schioppa
Journal:  Annu Rev Neurosci       Date:  2011       Impact factor: 12.449

9.  Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning.

Authors:  Mark E Walton; Timothy E J Behrens; Mark J Buckley; Peter H Rudebeck; Matthew F S Rushworth
Journal:  Neuron       Date:  2010-03-25       Impact factor: 17.173

10.  Associative learning of social value.

Authors:  Timothy E J Behrens; Laurence T Hunt; Mark W Woolrich; Matthew F S Rushworth
Journal:  Nature       Date:  2008-11-13       Impact factor: 49.962

View more
  141 in total

1.  Neuronal selectivity for spatial positions of offers and choices in five reward regions.

Authors:  Caleb E Strait; Brianna J Sleezer; Tommy C Blanchard; Habiba Azab; Meghan D Castagno; Benjamin Y Hayden
Journal:  J Neurophysiol       Date:  2015-12-02       Impact factor: 2.714

2.  Integrating salience and value in decision making.

Authors:  Kenway Louie
Journal:  Proc Natl Acad Sci U S A       Date:  2013-09-19       Impact factor: 11.205

3.  Using reinforcement learning models in social neuroscience: frameworks, pitfalls and suggestions of best practices.

Authors:  Lei Zhang; Lukas Lengersdorff; Nace Mikus; Jan Gläscher; Claus Lamm
Journal:  Soc Cogn Affect Neurosci       Date:  2020-07-30       Impact factor: 3.436

4.  Insular neural system controls decision-making in healthy and methamphetamine-treated rats.

Authors:  Hiroyuki Mizoguchi; Kentaro Katahira; Ayumu Inutsuka; Kazuya Fukumoto; Akihiro Nakamura; Tian Wang; Taku Nagai; Jun Sato; Makoto Sawada; Hideki Ohira; Akihiro Yamanaka; Kiyofumi Yamada
Journal:  Proc Natl Acad Sci U S A       Date:  2015-07-06       Impact factor: 11.205

5.  A functional difference in information processing between orbitofrontal cortex and ventral striatum during decision-making behaviour.

Authors:  Jeffrey J Stott; A David Redish
Journal:  Philos Trans R Soc Lond B Biol Sci       Date:  2014-11-05       Impact factor: 6.237

6.  Uncovering the spatio-temporal dynamics of value-based decision-making in the human brain: a combined fMRI-EEG study.

Authors:  Tobias Larsen; John P O'Doherty
Journal:  Philos Trans R Soc Lond B Biol Sci       Date:  2014-11-05       Impact factor: 6.237

7.  Reinforcement biases subsequent perceptual decisions when confidence is low, a widespread behavioral phenomenon.

Authors:  Armin Lak; Emily Hueske; Junya Hirokawa; Paul Masset; Torben Ott; Anne E Urai; Tobias H Donner; Matteo Carandini; Susumu Tonegawa; Naoshige Uchida; Adam Kepecs
Journal:  Elife       Date:  2020-04-15       Impact factor: 8.140

8.  Dopamine-associated cached values are not sufficient as the basis for action selection.

Authors:  Nick G Hollon; Monica M Arnold; Jerylin O Gan; Mark E Walton; Paul E M Phillips
Journal:  Proc Natl Acad Sci U S A       Date:  2014-12-08       Impact factor: 11.205

9.  Brain-machine interface in chronic stroke rehabilitation: a controlled study.

Authors:  Ander Ramos-Murguialday; Doris Broetz; Massimiliano Rea; Leonhard Läer; Ozge Yilmaz; Fabricio L Brasil; Giulia Liberati; Marco R Curado; Eliana Garcia-Cossio; Alexandros Vyziotis; Woosang Cho; Manuel Agostini; Ernesto Soares; Surjo Soekadar; Andrea Caria; Leonardo G Cohen; Niels Birbaumer
Journal:  Ann Neurol       Date:  2013-08-07       Impact factor: 10.422

10.  When Implicit Prosociality Trumps Selfishness: The Neural Valuation System Underpins More Optimal Choices When Learning to Avoid Harm to Others Than to Oneself.

Authors:  Lukas L Lengersdorff; Isabella C Wagner; Patricia L Lockwood; Claus Lamm
Journal:  J Neurosci       Date:  2020-08-24       Impact factor: 6.167

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.