Literature DB >> 32083297

Variability in Action Selection Relates to Striatal Dopamine 2/3 Receptor Availability in Humans: A PET Neuroimaging Study Using Reinforcement Learning and Active Inference Models.

Rick A Adams1,2,3,4, Michael Moutoussis5,6, Matthew M Nour3,4,7, Tarik Dahoun3,4,8, Declan Lewis1, Benjamin Illingworth1, Mattia Veronese9, Christoph Mathys6,10,11, Lieke de Boer12, Marc Guitart-Masip6,12, Karl J Friston5, Oliver D Howes3,4,7, Jonathan P Roiser1.   

Abstract

Choosing actions that result in advantageous outcomes is a fundamental function of nervous systems. All computational decision-making models contain a mechanism that controls the variability of (or confidence in) action selection, but its neural implementation is unclear-especially in humans. We investigated this mechanism using two influential decision-making frameworks: active inference (AI) and reinforcement learning (RL). In AI, the precision (inverse variance) of beliefs about policies controls action selection variability-similar to decision 'noise' parameters in RL-and is thought to be encoded by striatal dopamine signaling. We tested this hypothesis by administering a 'go/no-go' task to 75 healthy participants, and measuring striatal dopamine 2/3 receptor (D2/3R) availability in a subset (n = 25) using [11C]-(+)-PHNO positron emission tomography. In behavioral model comparison, RL performed best across the whole group but AI performed best in participants performing above chance levels. Limbic striatal D2/3R availability had linear relationships with AI policy precision (P = 0.029) as well as with RL irreducible decision 'noise' (P = 0.020), and this relationship with D2/3R availability was confirmed with a 'decision stochasticity' factor that aggregated across both models (P = 0.0006). These findings are consistent with occupancy of inhibitory striatal D2/3Rs decreasing the variability of action selection in humans.
© The Author(s) 2020. Published by Oxford University Press.

Entities:  

Keywords:  action selection; active inference; decision temperature; dopamine 2/3 receptors; go no-go task; reinforcement learning

Mesh:

Substances:

Year:  2020        PMID: 32083297      PMCID: PMC7233027          DOI: 10.1093/cercor/bhz327

Source DB:  PubMed          Journal:  Cereb Cortex        ISSN: 1047-3211            Impact factor:   5.357


  75 in total

1.  Cortical substrates for exploratory decisions in humans.

Authors:  Nathaniel D Daw; John P O'Doherty; Peter Dayan; Ben Seymour; Raymond J Dolan
Journal:  Nature       Date:  2006-06-15       Impact factor: 49.962

2.  A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli.

Authors:  J M Pearce; G Hall
Journal:  Psychol Rev       Date:  1980-11       Impact factor: 8.934

Review 3.  Inverted-U-shaped dopamine actions on human working memory and cognitive control.

Authors:  Roshan Cools; Mark D'Esposito
Journal:  Biol Psychiatry       Date:  2011-05-04       Impact factor: 13.382

4.  By carrot or by stick: cognitive reinforcement learning in parkinsonism.

Authors:  Michael J Frank; Lauren C Seeberger; Randall C O'reilly
Journal:  Science       Date:  2004-11-04       Impact factor: 47.728

5.  Reversal learning and dopamine: a bayesian perspective.

Authors:  Vincent D Costa; Valery L Tran; Janita Turchi; Bruno B Averbeck
Journal:  J Neurosci       Date:  2015-02-11       Impact factor: 6.167

6.  Ventral striatal dopamine modulation of different forms of behavioral flexibility.

Authors:  Desirae M Haluk; Stan B Floresco
Journal:  Neuropsychopharmacology       Date:  2009-03-04       Impact factor: 7.853

7.  In vivo quantification of regional dopamine-D3 receptor binding potential of (+)-PHNO: Studies in non-human primates and transgenic mice.

Authors:  Eugenii A Rabiner; Mark Slifstein; Jose Nobrega; Christophe Plisson; Mickael Huiban; Roger Raymond; Mustansir Diwan; Alan A Wilson; Patrick McCormick; Gabriella Gentile; Roger N Gunn; Marc A Laruelle
Journal:  Synapse       Date:  2009-09       Impact factor: 2.562

Review 8.  PET studies of cerebral levodopa metabolism: a review of clinical findings and modeling approaches.

Authors:  Yoshitaka Kumakura; Paul Cumming
Journal:  Neuroscientist       Date:  2009-12       Impact factor: 7.519

9.  Concurrent activation of striatal direct and indirect pathways during action initiation.

Authors:  Guohong Cui; Sang Beom Jun; Xin Jin; Michael D Pham; Steven S Vogel; David M Lovinger; Rui M Costa
Journal:  Nature       Date:  2013-01-23       Impact factor: 49.962

10.  Selective Effects of the Loss of NMDA or mGluR5 Receptors in the Reward System on Adaptive Decision-Making.

Authors:  Przemysław Eligiusz Cieślak; Woo-Young Ahn; Rafał Bogacz; Jan Rodriguez Parkitna
Journal:  eNeuro       Date:  2018-10-05
View more
  5 in total

1.  Everything is connected: Inference and attractors in delusions.

Authors:  Rick A Adams; Peter Vincent; David Benrimoh; Karl J Friston; Thomas Parr
Journal:  Schizophr Res       Date:  2021-08-09       Impact factor: 4.662

2.  Self-esteem depends on beliefs about the rate of change of social approval.

Authors:  Alexis An Yee Low; William John Telesfor Hopper; Ilinca Angelescu; Liam Mason; Geert-Jan Will; Michael Moutoussis
Journal:  Sci Rep       Date:  2022-04-22       Impact factor: 4.996

3.  The computational relationship between reinforcement learning, social inference, and paranoia.

Authors:  Joseph M Barnby; Mitul A Mehta; Michael Moutoussis
Journal:  PLoS Comput Biol       Date:  2022-07-25       Impact factor: 4.779

4.  Reduction in social learning and increased policy uncertainty about harmful intent is associated with pre-existing paranoid beliefs: Evidence from modelling a modified serial dictator game.

Authors:  Joseph M Barnby; Vaughan Bell; Mitul A Mehta; Michael Moutoussis
Journal:  PLoS Comput Biol       Date:  2020-10-15       Impact factor: 4.475

5.  Early life experience sets hard limits on motor learning as evidenced from artificial arm use.

Authors:  Roni O Maimon-Mor; Hunter R Schone; David Henderson Slater; A Aldo Faisal; Tamar R Makin
Journal:  Elife       Date:  2021-10-04       Impact factor: 8.140

  5 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.