Literature DB >> 29777827

Is the encoding of Reward Prediction Error reliable during development?

Hanna Keren1, Gang Chen2, Brenda Benson3, Monique Ernst4, Ellen Leibenluft5, Nathan A Fox6, Daniel S Pine3, Argyris Stringaris7.   

Abstract

Reward Prediction Errors (RPEs), defined as the difference between the expected and received outcomes, are integral to reinforcement learning models and play an important role in development and psychopathology. In humans, RPE encoding can be estimated using fMRI recordings, however, a basic measurement property of RPE signals, their test-retest reliability across different time scales, remains an open question. In this paper, we examine the 3-month and 3-year reliability of RPE encoding in youth (mean age at baseline = 10.6 ± 0.3 years), a period of developmental transitions in reward processing. We show that RPE encoding is differentially distributed between the positive values being encoded predominantly in the striatum and negative RPEs primarily encoded in the insula. The encoding of negative RPE values is highly reliable in the right insula, across both the long and the short time intervals. Insula reliability for RPE encoding is the most robust finding, while other regions, such as the striatum, are less consistent. Striatal reliability appeared significant as well once covarying for factors, which were possibly confounding the signal to noise ratio. By contrast, task activation during feedback in the striatum is highly reliable across both time intervals. These results demonstrate the valence-dependent differential encoding of RPE signals between the insula and striatum, and the consistency of RPE signals or lack thereof, during childhood and into adolescence. Characterizing the regions where the RPE signal in BOLD fMRI is a reliable marker is key for estimating reward-processing alterations in longitudinal designs, such as developmental or treatment studies.
Copyright © 2018 Elsevier Inc. All rights reserved.

Entities:  

Keywords:  Adolescence; Development; Prediction Error; Reliability; Reward; fMRI

Mesh:

Year:  2018        PMID: 29777827      PMCID: PMC7518449          DOI: 10.1016/j.neuroimage.2018.05.039

Source DB:  PubMed          Journal:  Neuroimage        ISSN: 1053-8119            Impact factor:   6.556


  66 in total

1.  Long-term test-retest reliability of functional MRI in a classification learning task.

Authors:  Adam R Aron; Mark A Gluck; Russell A Poldrack
Journal:  Neuroimage       Date:  2005-09-01       Impact factor: 6.556

2.  Midbrain dopamine neurons encode a quantitative reward prediction error signal.

Authors:  Hannah M Bayer; Paul W Glimcher
Journal:  Neuron       Date:  2005-07-07       Impact factor: 17.173

3.  Neural processing of reward and loss in girls at risk for major depression.

Authors:  Ian H Gotlib; J Paul Hamilton; Rebecca E Cooney; Manpreet K Singh; Melissa L Henry; Jutta Joormann
Journal:  Arch Gen Psychiatry       Date:  2010-04

4.  Longitudinal study of striatal activation to reward and loss anticipation from mid-adolescence into late adolescence/early adulthood.

Authors:  C Lamm; B E Benson; A E Guyer; K Perez-Edgar; N A Fox; D S Pine; M Ernst
Journal:  Brain Cogn       Date:  2014-01-28       Impact factor: 2.310

5.  Critical roles for anterior insula and dorsal striatum in punishment-based avoidance learning.

Authors:  Stefano Palminteri; Damian Justo; Céline Jauffret; Beth Pavlicek; Aurélie Dauta; Christine Delmaire; Virginie Czernecki; Carine Karachi; Laurent Capelle; Alexandra Durr; Mathias Pessiglione
Journal:  Neuron       Date:  2012-12-06       Impact factor: 17.173

6.  Validation of a child-friendly version of the monetary incentive delay task.

Authors:  Sarah M Helfinstein; Michael L Kirwan; Brenda E Benson; Michael G Hardin; Daniel S Pine; Monique Ernst; Nathan A Fox
Journal:  Soc Cogn Affect Neurosci       Date:  2012-05-07       Impact factor: 3.436

7.  Neuron-type-specific signals for reward and punishment in the ventral tegmental area.

Authors:  Jeremiah Y Cohen; Sebastian Haesler; Linh Vong; Bradford B Lowell; Naoshige Uchida
Journal:  Nature       Date:  2012-01-18       Impact factor: 49.962

8.  Accounting for Dynamic Fluctuations across Time when Examining fMRI Test-Retest Reliability: Analysis of a Reward Paradigm in the EMBARC Study.

Authors:  Henry W Chase; Jay C Fournier; Tsafrir Greenberg; Jorge R Almeida; Richelle Stiffler; Carlos R Zevallos; Haris Aslam; Crystal Cooper; Thilo Deckersbach; Sarah Weyandt; Phillip Adams; Marisa Toups; Tom Carmody; Maria A Oquendo; Scott Peltier; Maurizio Fava; Patrick J McGrath; Myrna Weissman; Ramin Parsey; Melvin G McInnis; Benji Kurian; Madhukar H Trivedi; Mary L Phillips
Journal:  PLoS One       Date:  2015-05-11       Impact factor: 3.240

9.  Reliability in adolescent fMRI within two years - a comparison of three tasks.

Authors:  Nora C Vetter; Julius Steding; Sarah Jurk; Stephan Ripke; Eva Mennigen; Michael N Smolka
Journal:  Sci Rep       Date:  2017-05-23       Impact factor: 4.379

10.  Clinical Depression and Punishment Sensitivity on the BART.

Authors:  David Hevey; Kevin Thomas; Sofia Laureano-Schelten; Karen Looney; Richard Booth
Journal:  Front Psychol       Date:  2017-05-02
View more
  5 in total

Review 1.  Exposure therapy for pediatric irritability: Theory and potential mechanisms.

Authors:  Katharina Kircanski; Michelle G Craske; Bruno B Averbeck; Daniel S Pine; Ellen Leibenluft; Melissa A Brotman
Journal:  Behav Res Ther       Date:  2019-04-22

2.  Reliability and stability challenges in ABCD task fMRI data.

Authors:  James T Kennedy; Michael P Harms; Ozlem Korucuoglu; Serguei V Astafiev; Deanna M Barch; Wesley K Thompson; James M Bjork; Andrey P Anokhin
Journal:  Neuroimage       Date:  2022-03-01       Impact factor: 7.400

Review 3.  Neurocognitive Development of Motivated Behavior: Dynamic Changes across Childhood and Adolescence.

Authors:  Dylan G Gee; Kevin G Bath; Carolyn M Johnson; Heidi C Meyer; Vishnu P Murty; Wouter van den Bos; Catherine A Hartley
Journal:  J Neurosci       Date:  2018-10-31       Impact factor: 6.167

4.  Test-retest reliability of functional MRI food receipt, anticipated receipt, and picture tasks.

Authors:  Sonja Yokum; Cara Bohon; Elliot Berkman; Eric Stice
Journal:  Am J Clin Nutr       Date:  2021-08-02       Impact factor: 7.045

5.  The longitudinal stability of fMRI activation during reward processing in adolescents and young adults.

Authors:  David A A Baranger; Morgan Lindenmuth; Melissa Nance; Amanda E Guyer; Kate Keenan; Alison E Hipwell; Daniel S Shaw; Erika E Forbes
Journal:  Neuroimage       Date:  2021-02-18       Impact factor: 6.556

  5 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.