Literature DB >> 33861952

Wave-like dopamine dynamics as a mechanism for spatiotemporal credit assignment.

Arif A Hamid1, Michael J Frank2, Christopher I Moore3.   

Abstract

Significant evidence supports the view that dopamine shapes learning by encoding reward prediction errors. However, it is unknown whether striatal targets receive tailored dopamine dynamics based on regional functional specialization. Here, we report wave-like spatiotemporal activity patterns in dopamine axons and release across the dorsal striatum. These waves switch between activational motifs and organize dopamine transients into localized clusters within functionally related striatal subregions. Notably, wave trajectories were tailored to task demands, propagating from dorsomedial to dorsolateral striatum when rewards are contingent on animal behavior and in the opponent direction when rewards are independent of behavioral responses. We propose a computational architecture in which striatal dopamine waves are sculpted by inference about agency and provide a mechanism to direct credit assignment to specialized striatal subregions. Supporting model predictions, dorsomedial dopamine activity during reward-pursuit signaled the extent of instrumental control and interacted with reward waves to predict future behavioral adjustments.
Copyright © 2021 Elsevier Inc. All rights reserved.

Entities:  

Keywords:  agency learning; basal ganglia; credit assignment; decisionmaking; dopamine; motivated behaviors; reinforcement learning; striatum

Mesh:

Substances:

Year:  2021        PMID: 33861952      PMCID: PMC8122079          DOI: 10.1016/j.cell.2021.03.046

Source DB:  PubMed          Journal:  Cell        ISSN: 0092-8674            Impact factor:   41.582


  107 in total

1.  Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons.

Authors:  Genela Morris; David Arkadir; Alon Nevet; Eilon Vaadia; Hagai Bergman
Journal:  Neuron       Date:  2004-07-08       Impact factor: 17.173

Review 2.  Habits, rituals, and the evaluative brain.

Authors:  Ann M Graybiel
Journal:  Annu Rev Neurosci       Date:  2008       Impact factor: 12.449

Review 3.  Computational models of motivated action selection in corticostriatal circuits.

Authors:  Michael J Frank
Journal:  Curr Opin Neurobiol       Date:  2011-04-15       Impact factor: 6.627

4.  Opponent actor learning (OpAL): modeling interactive effects of striatal dopamine on reinforcement learning and choice incentive.

Authors:  Anne G E Collins; Michael J Frank
Journal:  Psychol Rev       Date:  2014-07       Impact factor: 8.934

5.  Dopamine Secretion Is Mediated by Sparse Active Zone-like Release Sites.

Authors:  Changliang Liu; Lauren Kershberg; Jiexin Wang; Shirin Schneeberger; Pascal S Kaeser
Journal:  Cell       Date:  2018-02-01       Impact factor: 41.582

6.  Rapid signalling in distinct dopaminergic axons during locomotion and reward.

Authors:  M W Howe; D A Dombeck
Journal:  Nature       Date:  2016-07-11       Impact factor: 49.962

7.  Functional corticostriatal connection topographies predict goal directed behaviour in humans.

Authors:  Andre F Marquand; Koen V Haak; Christian F Beckmann
Journal:  Nat Hum Behav       Date:  2017-07-24

8.  Diametric neural ensemble dynamics in parkinsonian and dyskinetic states.

Authors:  Jones G Parker; Jesse D Marshall; Biafra Ahanonu; Yu-Wei Wu; Tony Hyun Kim; Benjamin F Grewe; Yanping Zhang; Jin Zhong Li; Jun B Ding; Michael D Ehlers; Mark J Schnitzer
Journal:  Nature       Date:  2018-05-02       Impact factor: 49.962

9.  Intact-Brain Analyses Reveal Distinct Information Carried by SNc Dopamine Subcircuits.

Authors:  Talia N Lerner; Carrie Shilyansky; Thomas J Davidson; Kathryn E Evans; Kevin T Beier; Kelly A Zalocusky; Ailey K Crow; Robert C Malenka; Liqun Luo; Raju Tomer; Karl Deisseroth
Journal:  Cell       Date:  2015-07-30       Impact factor: 41.582

10.  Anatomically segregated basal ganglia pathways allow parallel behavioral modulation.

Authors:  Jaeeon Lee; Wengang Wang; Bernardo L Sabatini
Journal:  Nat Neurosci       Date:  2020-09-28       Impact factor: 24.884

View more
  22 in total

1.  Nigrostriatal dopamine signals sequence-specific action-outcome prediction errors.

Authors:  Nick G Hollon; Elora W Williams; Christopher D Howard; Hao Li; Tavish I Traut; Xin Jin
Journal:  Curr Biol       Date:  2021-10-11       Impact factor: 10.834

Review 2.  Vigor, Effort-Related Aspects of Motivation and Anhedonia.

Authors:  Michael T Treadway; John D Salamone
Journal:  Curr Top Behav Neurosci       Date:  2022

3.  Dopamine signaling in the dorsomedial striatum promotes compulsive behavior.

Authors:  Jillian L Seiler; Caitlin V Cosme; Venus N Sherathiya; Michael D Schaid; Joseph M Bianco; Abigael S Bridgemohan; Talia N Lerner
Journal:  Curr Biol       Date:  2022-02-07       Impact factor: 10.900

4.  Striatal BOLD and Midfrontal Theta Power Express Motivation for Action.

Authors:  Johannes Algermissen; Jennifer C Swart; René Scheeringa; Roshan Cools; Hanneke E M den Ouden
Journal:  Cereb Cortex       Date:  2022-07-12       Impact factor: 4.861

5.  Stress-sensitive inference of task controllability.

Authors:  Verena Ly; Roshan Cools; Romain Ligneul; Zachary F Mainen
Journal:  Nat Hum Behav       Date:  2022-03-10

6.  Neuronal population activity dynamics reveal a low-dimensional signature of operant learning in Aplysia.

Authors:  Renan M Costa; Douglas A Baxter; John H Byrne
Journal:  Commun Biol       Date:  2022-01-24

7.  Cell-type-specific neuromodulation guides synaptic credit assignment in a spiking neural network.

Authors:  Yuhan Helena Liu; Stephen Smith; Stefan Mihalas; Eric Shea-Brown; Uygar Sümbül
Journal:  Proc Natl Acad Sci U S A       Date:  2021-12-21       Impact factor: 11.205

8.  "Liking" as an early and editable draft of long-run affective value.

Authors:  Peter Dayan
Journal:  PLoS Biol       Date:  2022-01-05       Impact factor: 8.029

Review 9.  Dopamine, Updated: Reward Prediction Error and Beyond.

Authors:  Talia N Lerner; Ashley L Holloway; Jillian L Seiler
Journal:  Curr Opin Neurobiol       Date:  2020-11-14       Impact factor: 6.627

Review 10.  A mosaic of cost-benefit control over cortico-striatal circuitry.

Authors:  Andrew Westbrook; Michael J Frank; Roshan Cools
Journal:  Trends Cogn Sci       Date:  2021-06-10       Impact factor: 24.482

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.