Literature DB >> 32321744

Rapid Learning of Odor-Value Association in the Olfactory Striatum.

Daniel J Millman1,2, Venkatesh N Murthy3,4.   

Abstract

Rodents can successfully learn multiple novel stimulus-response associations after only a few repetitions when the contingencies predict reward. The circuits modified during such reinforcement learning to support decision-making are not known, but the olfactory tubercle (OT) and posterior piriform cortex (pPC) are candidates for decoding reward category from olfactory sensory input and relaying this information to cognitive and motor areas. Through single-cell recordings in behaving male and female C57BL/6 mice, we show here that an explicit representation for reward category emerges in the OT within minutes of learning a novel odor-reward association, whereas the pPC lacks an explicit representation even after weeks of overtraining. The explicit reward category representation in OT is visible in the first sniff (50-100 ms) of an odor on each trial, and precedes the motor action. Together, these results suggest that the coding of stimulus information required for reward prediction does not occur within olfactory cortex, but rather in circuits involving the olfactory striatum.SIGNIFICANCE STATEMENT Rodents are olfactory specialists and can use odors to learn contingencies quickly and well. We have found that mice can readily learn to place multiple odors into rewarded and unrewarded categories. Once they have learned the rule, they can do such categorization in a matter of minutes (<10 trials). We found that neural activity in olfactory cortex largely reflects sensory coding, with very little explicit information about categories. By contrast, neural activity in a brain region in the ventral striatum is rapidly modified in a matter of minutes to reflect reward category. Our experiments set up a paradigm for studying rapid sensorimotor reinforcement in a circuit that is right at the interface of sensory input and reward areas.
Copyright © 2020 the authors.

Entities:  

Keywords:  decoding; olfactory tubercle; piriform cortex; rapid learning; reinforcement learning; reward categorization

Mesh:

Year:  2020        PMID: 32321744      PMCID: PMC7252476          DOI: 10.1523/JNEUROSCI.2604-19.2020

Source DB:  PubMed          Journal:  J Neurosci        ISSN: 0270-6474            Impact factor:   6.167


  52 in total

Review 1.  Multiple reward signals in the brain.

Authors:  W Schultz
Journal:  Nat Rev Neurosci       Date:  2000-12       Impact factor: 34.870

2.  Characterizing the sparseness of neural codes.

Authors:  B Willmore; D J Tolhurst
Journal:  Network       Date:  2001-08       Impact factor: 1.273

3.  Fast readout of object identity from macaque inferior temporal cortex.

Authors:  Chou P Hung; Gabriel Kreiman; Tomaso Poggio; James J DiCarlo
Journal:  Science       Date:  2005-11-04       Impact factor: 47.728

4.  Representations of odor in the piriform cortex.

Authors:  Dan D Stettler; Richard Axel
Journal:  Neuron       Date:  2009-09-24       Impact factor: 17.173

5.  Cell configurations in the olfactory tubercle of the rat.

Authors:  O E Millhouse; L Heimer
Journal:  J Comp Neurol       Date:  1984-10-01       Impact factor: 3.215

6.  Reading Out Olfactory Receptors: Feedforward Circuits Detect Odors in Mixtures without Demixing.

Authors:  Alexander Mathis; Dan Rokni; Vikrant Kapoor; Matthias Bethge; Venkatesh N Murthy
Journal:  Neuron       Date:  2016-09-01       Impact factor: 17.173

7.  Complementary codes for odor identity and intensity in olfactory cortex.

Authors:  Kevin A Bolding; Kevin M Franks
Journal:  Elife       Date:  2017-04-05       Impact factor: 8.140

8.  Population Coding in an Innately Relevant Olfactory Area.

Authors:  Giuliano Iurilli; Sandeep Robert Datta
Journal:  Neuron       Date:  2017-02-28       Impact factor: 17.173

9.  Phasic Dopamine Modifies Sensory-Driven Output of Striatal Neurons through Synaptic Plasticity.

Authors:  Sebastian Wieland; Sebastian Schindler; Cathrin Huber; Georg Köhr; Manfred J Oswald; Wolfgang Kelsch
Journal:  J Neurosci       Date:  2015-07-08       Impact factor: 6.167

10.  Tetrodes markedly improve the reliability and yield of multiple single-unit isolation from multi-unit recordings in cat striate cortex.

Authors:  C M Gray; P E Maldonado; M Wilson; B McNaughton
Journal:  J Neurosci Methods       Date:  1995-12       Impact factor: 2.390

View more
  13 in total

Review 1.  The Tubular Striatum.

Authors:  Daniel W Wesson
Journal:  J Neurosci       Date:  2020-09-23       Impact factor: 6.167

2.  Striatal hub of dynamic and stabilized prediction coding in forebrain networks for olfactory reinforcement learning.

Authors:  Christian Clemm von Hohenberg; Eleonora Russo; Wolfgang Kelsch; Laurens Winkelmeier; Carla Filosa; Renée Hartig; Max Scheller; Markus Sack; Jonathan R Reinwald; Robert Becker; David Wolf; Martin Fungisai Gerchen; Alexander Sartorius; Andreas Meyer-Lindenberg; Wolfgang Weber-Fahr
Journal:  Nat Commun       Date:  2022-06-08       Impact factor: 17.694

3.  Distinct representation of cue-outcome association by D1 and D2 neurons in the ventral striatum's olfactory tubercle.

Authors:  Nuné Martiros; Vikrant Kapoor; Spencer E Kim; Venkatesh N Murthy
Journal:  Elife       Date:  2022-06-16       Impact factor: 8.713

Review 4.  Neural Circuitry for Stress Information of Environmental and Internal Odor Worlds.

Authors:  Kensaku Mori; Hitoshi Sakano
Journal:  Front Behav Neurosci       Date:  2022-06-16       Impact factor: 3.617

5.  Spatial maps in piriform cortex during olfactory navigation.

Authors:  Cindy Poo; Gautam Agarwal; Niccolò Bonacchi; Zachary F Mainen
Journal:  Nature       Date:  2021-12-22       Impact factor: 69.504

6.  Rapid Bayesian learning in the mammalian olfactory system.

Authors:  Naoki Hiratani; Peter E Latham
Journal:  Nat Commun       Date:  2020-07-31       Impact factor: 14.919

7.  A Neural System that Represents the Association of Odors with Rewarded Outcomes and Promotes Behavioral Engagement.

Authors:  Marie A Gadziola; Lucas A Stetzik; Katherine N Wright; Adrianna J Milton; Keiko Arakawa; María Del Mar Cortijo; Daniel W Wesson
Journal:  Cell Rep       Date:  2020-07-21       Impact factor: 9.423

Review 8.  Olfactory modulation of the medial prefrontal cortex circuitry: Implications for social cognition.

Authors:  Janardhan P Bhattarai; Semra Etyemez; Hanna Jaaro-Peled; Emma Janke; Usuy D Leon Tolosa; Atsushi Kamiya; Jay A Gottfried; Akira Sawa; Minghong Ma
Journal:  Semin Cell Dev Biol       Date:  2021-05-09       Impact factor: 7.499

9.  The tubular striatum and nucleus accumbens distinctly represent reward-taking and reward-seeking.

Authors:  Katherine N Wright; Daniel W Wesson
Journal:  J Neurophysiol       Date:  2020-11-11       Impact factor: 2.714

10.  Phasic dopamine reinforces distinct striatal stimulus encoding in the olfactory tubercle driving dopaminergic reward prediction.

Authors:  Lars-Lennart Oettl; Max Scheller; Carla Filosa; Eleonora Russo; Wolfgang Kelsch; Sebastian Wieland; Franziska Haag; Cathrin Loeb; Daniel Durstewitz; Roman Shusterman
Journal:  Nat Commun       Date:  2020-07-10       Impact factor: 14.919

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.