Literature DB >> 34936883

Serotonin neurons modulate learning rate through uncertainty.

Cooper D Grossman1, Bilal A Bari1, Jeremiah Y Cohen2.   

Abstract

Regulating how fast to learn is critical for flexible behavior. Learning about the consequences of actions should be slow in stable environments, but accelerate when that environment changes. Recognizing stability and detecting change are difficult in environments with noisy relationships between actions and outcomes. Under these conditions, theories propose that uncertainty can be used to modulate learning rates ("meta-learning"). We show that mice behaving in a dynamic foraging task exhibit choice behavior that varied as a function of two forms of uncertainty estimated from a meta-learning model. The activity of dorsal raphe serotonin neurons tracked both types of uncertainty in the foraging task as well as in a dynamic Pavlovian task. Reversible inhibition of serotonin neurons in the foraging task reproduced changes in learning predicted by a simulated lesion of meta-learning in the model. We thus provide a quantitative link between serotonin neuron activity, learning, and decision making.
Copyright © 2021 Elsevier Inc. All rights reserved.

Entities:  

Keywords:  decision making; dorsal raphe; learning; serotonin; uncertainty

Mesh:

Substances:

Year:  2021        PMID: 34936883      PMCID: PMC8825708          DOI: 10.1016/j.cub.2021.12.006

Source DB:  PubMed          Journal:  Curr Biol        ISSN: 0960-9822            Impact factor:   10.834


  110 in total

Review 1.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates.

Authors:  B W Balleine; A Dickinson
Journal:  Neuropharmacology       Date:  1998 Apr-May       Impact factor: 5.250

2.  Functionally dissociable influences on learning rate in a dynamic environment.

Authors:  Joseph T McGuire; Matthew R Nassar; Joshua I Gold; Joseph W Kable
Journal:  Neuron       Date:  2014-11-19       Impact factor: 17.173

3.  Striatal action-value neurons reconsidered.

Authors:  Lotem Elber-Dorozko; Yonatan Loewenstein
Journal:  Elife       Date:  2018-05-31       Impact factor: 8.140

4.  Balancing New against Old Information: The Role of Puzzlement Surprise in Learning.

Authors:  Mohammadjavad Faraji; Kerstin Preuschoff; Wulfram Gerstner
Journal:  Neural Comput       Date:  2017-10-24       Impact factor: 2.026

5.  Tryptophan depletion impairs stimulus-reward learning while methylphenidate disrupts attentional control in healthy young adults: implications for the monoaminergic basis of impulsive behaviour.

Authors:  R D Rogers; A J Blackshaw; H C Middleton; K Matthews; K Hawtin; C Crowley; A Hopwood; C Wallace; J F Deakin; B J Sahakian; T W Robbins
Journal:  Psychopharmacology (Berl)       Date:  1999-10       Impact factor: 4.530

6.  Uncertainty, neuromodulation, and attention.

Authors:  Angela J Yu; Peter Dayan
Journal:  Neuron       Date:  2005-05-19       Impact factor: 17.173

Review 7.  5-HT1A Receptor-Mediated Autoinhibition and the Control of Serotonergic Cell Firing.

Authors:  Rodrigo Andrade; Daniel Huereca; Joseph G Lyons; Elaine M Andrade; Kelly M McGregor
Journal:  ACS Chem Neurosci       Date:  2015-05-26       Impact factor: 4.418

8.  Organization of monosynaptic inputs to the serotonin and dopamine neuromodulatory systems.

Authors:  Sachie K Ogawa; Jeremiah Y Cohen; Dabin Hwang; Naoshige Uchida; Mitsuko Watabe-Uchida
Journal:  Cell Rep       Date:  2014-08-06       Impact factor: 9.423

9.  Selective serotonergic excitation of callosal projection neurons.

Authors:  Daniel Avesar; Allan T Gulledge
Journal:  Front Neural Circuits       Date:  2012-03-20       Impact factor: 3.492

10.  Comprehensive topographical map of the serotonergic fibers in the male mouse brain.

Authors:  Janak R Awasthi; Kota Tamada; Eric T N Overton; Toru Takumi
Journal:  J Comp Neurol       Date:  2020-09-21       Impact factor: 3.215

View more
  7 in total

1.  Sex differences in learning from exploration.

Authors:  Cathy S Chen; Evan Knep; Autumn Han; R Becket Ebitz; Nicola M Grissom
Journal:  Elife       Date:  2021-11-19       Impact factor: 8.140

2.  Relative salience signaling within a thalamo-orbitofrontal circuit governs learning rate.

Authors:  Vijay Mohan K Namboodiri; Taylor Hobbs; Ivan Trujillo-Pisanty; Rhiana C Simon; Madelyn M Gray; Garret D Stuber
Journal:  Curr Biol       Date:  2021-10-11       Impact factor: 10.834

3.  Regulation of social hierarchy learning by serotonin transporter availability.

Authors:  Remi Janet; Romain Ligneul; Annabel B Losecaat-Vermeer; Remi Philippe; Gabriele Bellucci; Edmund Derrington; Soyoung Q Park; Jean-Claude Dreher
Journal:  Neuropsychopharmacology       Date:  2022-08-09       Impact factor: 8.294

4.  Superstitious learning of abstract order from random reinforcement.

Authors:  Yuhao Jin; Greg Jensen; Jacqueline Gottlieb; Vincent Ferrera
Journal:  Proc Natl Acad Sci U S A       Date:  2022-08-23       Impact factor: 12.779

5.  Norepinephrine potentiates and serotonin depresses visual cortical responses by transforming eligibility traces.

Authors:  Su Z Hong; Lukas Mesik; Cooper D Grossman; Jeremiah Y Cohen; Boram Lee; Daniel Severin; Hey-Kyoung Lee; Johannes W Hell; Alfredo Kirkwood
Journal:  Nat Commun       Date:  2022-06-09       Impact factor: 17.694

6.  Reinforcement learning modeling reveals a reward-history-dependent strategy underlying reversal learning in squirrel monkeys.

Authors:  Bilal A Bari; Megan J Moerke; Hank P Jedema; Devin P Effinger; Jeremiah Y Cohen; Charles W Bradberry
Journal:  Behav Neurosci       Date:  2021-09-27       Impact factor: 1.912

7.  Behavioural specialization and learning in social networks.

Authors:  Olof Leimar; Sasha R X Dall; Alasdair I Houston; John M McNamara
Journal:  Proc Biol Sci       Date:  2022-08-10       Impact factor: 5.530

  7 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.