Literature DB >> 30181136

Brief, But Not Prolonged, Pauses in the Firing of Midbrain Dopamine Neurons Are Sufficient to Produce a Conditioned Inhibitor.

Chun Yun Chang1, Matthew P H Gardner2, Jessica C Conroy2, Leslie R Whitaker2, Geoffrey Schoenbaum1,3,4.   

Abstract

Prediction errors are critical for associative learning. In the brain, these errors are thought to be signaled, in part, by midbrain dopamine neurons. However, although there is substantial direct evidence that brief increases in the firing of these neurons can mimic positive prediction errors, there is less evidence that brief pauses mimic negative errors. Whereas pauses in the firing of midbrain dopamine neurons can substitute for missing negative prediction errors to drive extinction, it has been suggested that this effect might be attributable to changes in salience rather than the operation of this signal as a negative prediction error. Here we address this concern by showing that the same pattern of inhibition will create a cue able to meet the classic definition of a conditioned inhibitor by showing suppression of responding in a summation test and slower learning in a retardation test. Importantly, these classic criteria were designed to rule out explanations founded on attention or salience; thus the results cannot be explained in this manner. We also show that this pattern of behavior is not produced by a single, prolonged, ramped period of inhibition, suggesting that it is precisely timed, sudden change and not duration that conveys the teaching signal.SIGNIFICANCE STATEMENT Here we show that brief pauses in the firing of midbrain dopamine neurons are sufficient to produce a cue that meets the classic criteria defining a conditioned inhibitor, or a cue that predicts the omission of a reward. These criteria were developed to distinguish actual learning from salience or attentional effects; thus these results formally show that brief pauses in the firing of dopamine neurons can serve as key teaching signals in the brain. Interestingly, this was not true for gradual prolonged pauses, suggesting it is the dynamic change in firing that serves as the teaching signal.
Copyright © 2018 the authors 0270-6474/18/388822-09$15.00/0.

Entities:  

Keywords:  associative learning; conditioned inhibition; dopamine; prediction error; rat; ventral tegmental area

Mesh:

Year:  2018        PMID: 30181136      PMCID: PMC6181314          DOI: 10.1523/JNEUROSCI.0144-18.2018

Source DB:  PubMed          Journal:  J Neurosci        ISSN: 0270-6474            Impact factor:   6.167


  43 in total

Review 1.  Opponent interactions between serotonin and dopamine.

Authors:  Nathaniel D Daw; Sham Kakade; Peter Dayan
Journal:  Neural Netw       Date:  2002 Jun-Jul

2.  Negative reward signals from the lateral habenula to dopamine neurons are mediated by rostromedial tegmental nucleus in primates.

Authors:  Simon Hong; Thomas C Jhou; Mitchell Smith; Kadharbatcha S Saleem; Okihide Hikosaka
Journal:  J Neurosci       Date:  2011-08-10       Impact factor: 6.167

3.  Lateral habenula stimulation inhibits rat midbrain dopamine neurons through a GABA(A) receptor-mediated mechanism.

Authors:  Huifang Ji; Paul D Shepard
Journal:  J Neurosci       Date:  2007-06-27       Impact factor: 6.167

4.  Burst activity of ventral tegmental dopamine neurons is elicited by sensory stimuli in the awake cat.

Authors:  J C Horvitz; T Stewart; B L Jacobs
Journal:  Brain Res       Date:  1997-06-13       Impact factor: 3.252

5.  Dopamine Neurons Respond to Errors in the Prediction of Sensory Features of Expected Rewards.

Authors:  Yuji K Takahashi; Hannah M Batchelor; Bing Liu; Akash Khanna; Marisela Morales; Geoffrey Schoenbaum
Journal:  Neuron       Date:  2017-09-13       Impact factor: 17.173

Review 6.  Model-based predictions for dopamine.

Authors:  Angela J Langdon; Melissa J Sharpe; Geoffrey Schoenbaum; Yael Niv
Journal:  Curr Opin Neurobiol       Date:  2017-10-31       Impact factor: 6.627

7.  Phasic dopamine release in the rat nucleus accumbens symmetrically encodes a reward prediction error term.

Authors:  Andrew S Hart; Robb B Rutledge; Paul W Glimcher; Paul E M Phillips
Journal:  J Neurosci       Date:  2014-01-15       Impact factor: 6.167

8.  Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards.

Authors:  Matthew R Roesch; Donna J Calu; Geoffrey Schoenbaum
Journal:  Nat Neurosci       Date:  2007-11-18       Impact factor: 24.884

9.  Overriding phasic dopamine signals redirects action selection during risk/reward decision making.

Authors:  Colin M Stopper; Maric T L Tse; David R Montes; Candice R Wiedman; Stan B Floresco
Journal:  Neuron       Date:  2014-09-11       Impact factor: 17.173

10.  Dopamine transients are sufficient and necessary for acquisition of model-based associations.

Authors:  Melissa J Sharpe; Chun Yun Chang; Melissa A Liu; Hannah M Batchelor; Lauren E Mueller; Joshua L Jones; Yael Niv; Geoffrey Schoenbaum
Journal:  Nat Neurosci       Date:  2017-04-03       Impact factor: 24.884

View more
  13 in total

1.  Distinct temporal difference error signals in dopamine axons in three regions of the striatum in a decision-making task.

Authors:  Iku Tsutsui-Kimura; Hideyuki Matsumoto; Korleki Akiti; Melissa M Yamada; Naoshige Uchida; Mitsuko Watabe-Uchida
Journal:  Elife       Date:  2020-12-21       Impact factor: 8.140

2.  Dopaminergic modulation of the exploration/exploitation trade-off in human decision-making.

Authors:  Karima Chakroun; David Mathar; Antonius Wiehler; Florian Ganzer; Jan Peters
Journal:  Elife       Date:  2020-06-02       Impact factor: 8.140

3.  Three Rostromedial Tegmental Afferents Drive Triply Dissociable Aspects of Punishment Learning and Aversive Valence Encoding.

Authors:  Hao Li; Peter J Vento; Jeffrey Parrilla-Carrero; Dominika Pullmann; Ying S Chao; Maya Eid; Thomas C Jhou
Journal:  Neuron       Date:  2019-10-15       Impact factor: 17.173

Review 4.  Neural substrates of appetitive and aversive prediction error.

Authors:  Mihaela D Iordanova; Joanna Oi-Yue Yau; Michael A McDannald; Laura H Corbit
Journal:  Neurosci Biobehav Rev       Date:  2021-01-13       Impact factor: 8.989

Review 5.  The Role of the Lateral Habenula in Inhibitory Learning from Reward Omission.

Authors:  Rodrigo Sosa; Jesús Mata-Luévanos; Mario Buenrostro-Jáuregui
Journal:  eNeuro       Date:  2021-06-22

6.  Past experience shapes the neural circuits recruited for future learning.

Authors:  Melissa J Sharpe; Hannah M Batchelor; Lauren E Mueller; Matthew P H Gardner; Geoffrey Schoenbaum
Journal:  Nat Neurosci       Date:  2021-02-15       Impact factor: 28.771

Review 7.  Dopamine signals as temporal difference errors: recent advances.

Authors:  Clara Kwon Starkweather; Naoshige Uchida
Journal:  Curr Opin Neurobiol       Date:  2020-11-10       Impact factor: 7.070

8.  Locus Coeruleus Activation Patterns Differentially Modulate Odor Discrimination Learning and Odor Valence in Rats.

Authors:  Abhinaba Ghosh; Faghihe Massaeli; Kyron D Power; Tamunotonye Omoluabi; Sarah E Torraville; Julia B Pritchett; Tayebeh Sepahvand; Vanessa D Strong; Camila Reinhardt; Xihua Chen; Gerard M Martin; Carolyn W Harley; Qi Yuan
Journal:  Cereb Cortex Commun       Date:  2021-04-05

Review 9.  Recent advances in understanding the role of phasic dopamine activity.

Authors:  Wolfram Schultz
Journal:  F1000Res       Date:  2019-09-24

10.  Generality and opponency of rostromedial tegmental (RMTg) roles in valence processing.

Authors:  Hao Li; Dominika Pullmann; Jennifer Y Cho; Maya Eid; Thomas C Jhou
Journal:  Elife       Date:  2019-01-22       Impact factor: 8.140

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.