Literature DB >> 19404458

Reinforcement learning: Computational theory and biological mechanisms.

Kenji Doya1.   

Abstract

Reinforcement learning is a computational framework for an active agent to learn behaviors on the basis of a scalar reward signal. The agent can be an animal, a human, or an artificial system such as a robot or a computer program. The reward can be food, water, money, or whatever measure of the performance of the agent. The theory of reinforcement learning, which was developed in an artificial intelligence community with intuitions from animal learning theory, is now giving a coherent account on the function of the basal ganglia. It now serves as the "common language" in which biologists, engineers, and social scientists can exchange their problems and findings. This article reviews the basic theoretical framework of reinforcement learning and discusses its recent and future contributions toward the understanding of animal behaviors and human decision making.

Entities:  

Year:  2007        PMID: 19404458      PMCID: PMC2645553          DOI: 10.2976/1.2732246/10.2976/1

Source DB:  PubMed          Journal:  HFSP J        ISSN: 1955-205X


  52 in total

Review 1.  Internal models for motor control and trajectory planning.

Authors:  M Kawato
Journal:  Curr Opin Neurobiol       Date:  1999-12       Impact factor: 6.627

Review 2.  Cellular, synaptic and network effects of neuromodulation.

Authors:  Eve Marder; Vatsala Thirumalai
Journal:  Neural Netw       Date:  2002 Jun-Jul

Review 3.  Opponent interactions between serotonin and dopamine.

Authors:  Nathaniel D Daw; Sham Kakade; Peter Dayan
Journal:  Neural Netw       Date:  2002 Jun-Jul

4.  Matching behavior and the representation of value in the parietal cortex.

Authors:  Leo P Sugrue; Greg S Corrado; William T Newsome
Journal:  Science       Date:  2004-06-18       Impact factor: 47.728

5.  Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops.

Authors:  Saori C Tanaka; Kenji Doya; Go Okada; Kazutaka Ueda; Yasumasa Okamoto; Shigeto Yamawaki
Journal:  Nat Neurosci       Date:  2004-07-04       Impact factor: 24.884

Review 6.  Neuroeconomics: the consilience of brain and decision.

Authors:  Paul W Glimcher; Aldo Rustichini
Journal:  Science       Date:  2004-10-15       Impact factor: 47.728

7.  The cerebellum communicates with the basal ganglia.

Authors:  Eiji Hoshi; Léon Tremblay; Jean Féger; Peter L Carras; Peter L Strick
Journal:  Nat Neurosci       Date:  2005-10-02       Impact factor: 24.884

Review 8.  A neural substrate of prediction and reward.

Authors:  W Schultz; P Dayan; P R Montague
Journal:  Science       Date:  1997-03-14       Impact factor: 47.728

Review 9.  Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: their role in planning and controlling action.

Authors:  J C Houk; S P Wise
Journal:  Cereb Cortex       Date:  1995 Mar-Apr       Impact factor: 5.357

10.  Double dissociation between serotonergic and dopaminergic modulation of medial prefrontal and orbitofrontal cortex during a test of impulsive choice.

Authors:  Catharine A Winstanley; David E H Theobald; Jeffrey W Dalley; Rudolf N Cardinal; Trevor W Robbins
Journal:  Cereb Cortex       Date:  2005-04-13       Impact factor: 5.357

View more
  32 in total

Review 1.  Human category learning 2.0.

Authors:  F Gregory Ashby; W Todd Maddox
Journal:  Ann N Y Acad Sci       Date:  2010-12-23       Impact factor: 5.691

Review 2.  Understanding neural coding through the model-based analysis of decision making.

Authors:  Greg Corrado; Kenji Doya
Journal:  J Neurosci       Date:  2007-08-01       Impact factor: 6.167

3.  How can we learn efficiently to act optimally and flexibly?

Authors:  Kenji Doya
Journal:  Proc Natl Acad Sci U S A       Date:  2009-07-07       Impact factor: 11.205

Review 4.  Cortical and basal ganglia contributions to habit learning and automaticity.

Authors:  F Gregory Ashby; Benjamin O Turner; Jon C Horvitz
Journal:  Trends Cogn Sci       Date:  2010-03-05       Impact factor: 20.229

5.  [Botulinum toxin: the misguided path].

Authors:  W Harth
Journal:  Hautarzt       Date:  2013-06       Impact factor: 0.751

Review 6.  Attention as an effect not a cause.

Authors:  Richard J Krauzlis; Anil Bollimunta; Fabrice Arcizet; Lupeng Wang
Journal:  Trends Cogn Sci       Date:  2014-06-19       Impact factor: 20.229

7.  The Protective Action Encoding of Serotonin Transients in the Human Brain.

Authors:  Rosalyn J Moran; Kenneth T Kishida; Terry Lohrenz; Ignacio Saez; Adrian W Laxton; Mark R Witcher; Stephen B Tatter; Thomas L Ellis; Paul Em Phillips; Peter Dayan; P Read Montague
Journal:  Neuropsychopharmacology       Date:  2018-01-03       Impact factor: 7.853

8.  Cosmetic use of botulinum toxin-a affects processing of emotional language.

Authors:  David A Havas; Arthur M Glenberg; Karol A Gutowski; Mark J Lucarelli; Richard J Davidson
Journal:  Psychol Sci       Date:  2010-06-14

9.  Learning to represent reward structure: a key to adapting to complex environments.

Authors:  Hiroyuki Nakahara; Okihide Hikosaka
Journal:  Neurosci Res       Date:  2012-10-13       Impact factor: 3.304

10.  A kinetic model of dopamine- and calcium-dependent striatal synaptic plasticity.

Authors:  Takashi Nakano; Tomokazu Doi; Junichiro Yoshimoto; Kenji Doya
Journal:  PLoS Comput Biol       Date:  2010-02-12       Impact factor: 4.475

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.