Literature DB >> 35042770

Integrating Reward Information for Prospective Behavior.

Sam Hall-McMaster1,2, Mark G Stokes3,2, Nicholas E Myers3,2.   

Abstract

Value-based decision-making is often studied in a static context, where participants decide which option to select from those currently available. However, everyday life often involves an additional dimension: deciding when to select to maximize reward. Recent evidence suggests that agents track the latent reward of an option, updating changes in their latent reward estimate, to achieve appropriate selection timing (latent reward tracking). However, this strategy can be difficult to distinguish from one in which the optimal selection time is estimated in advance, allowing an agent to wait a predetermined amount of time before selecting, without needing to monitor an option's latent reward (distance-to-goal tracking). Here, we show that these strategies can in principle be dissociated. Human brain activity was recorded using electroencephalography (EEG), while female and male participants performed a novel decision task. Participants were shown an option and decided when to select it, as its latent reward changed from trial-to-trial. While the latent reward was uncued, it could be estimated using cued information about the option's starting value and value growth rate. We then used representational similarity analysis (RSA) to assess whether EEG signals more closely resembled latent reward tracking or distance-to-goal tracking. This approach successfully dissociated the strategies in this task. Starting value and growth rate were translated into a distance-to-goal signal, far in advance of selecting the option. Latent reward could not be independently decoded. These results demonstrate the feasibility of using high temporal resolution neural recordings to identify internally computed decision variables in the human brain.SIGNIFICANCE STATEMENT Reward-seeking behavior involves acting at the right time. However, the external world does not always tell us when an action is most rewarding, necessitating internal representations that guide action timing. Specifying this internal neural representation is challenging because it might stem from a variety of strategies, many of which make similar predictions about brain activity. This study used a novel approach to test whether alternative strategies could be dissociated in principle. Using representational similarity analysis (RSA), we were able to distinguish between candidate internal representations for selection timing. This shows how pattern analysis methods can be used to measure latent decision information in noninvasive neural data.
Copyright © 2022 the authors.

Entities:  

Keywords:  decision-making; pattern analysis; reward maximization; selection timing

Mesh:

Year:  2022        PMID: 35042770      PMCID: PMC8896545          DOI: 10.1523/JNEUROSCI.1113-21.2021

Source DB:  PubMed          Journal:  J Neurosci        ISSN: 0270-6474            Impact factor:   6.709


  33 in total

1.  Computational neuroimaging: localising Greek letters? Comment on Forstmann et al.

Authors:  Jill X O'Reilly; Rogier B Mars
Journal:  Trends Cogn Sci       Date:  2011-08-22       Impact factor: 20.229

2.  A Bayesian approach to introducing anatomo-functional priors in the EEG/MEG inverse problem.

Authors:  S Baillet; L Garnero
Journal:  IEEE Trans Biomed Eng       Date:  1997-05       Impact factor: 4.538

Review 3.  Mental labour.

Authors:  Wouter Kool; Matthew Botvinick
Journal:  Nat Hum Behav       Date:  2018-09-03

Review 4.  Decoding Dynamic Brain Patterns from Evoked Responses: A Tutorial on Multivariate Pattern Analysis Applied to Time Series Neuroimaging Data.

Authors:  Tijl Grootswagers; Susan G Wardle; Thomas A Carlson
Journal:  J Cogn Neurosci       Date:  2016-10-25       Impact factor: 3.225

5.  The opportunity cost of time modulates cognitive effort.

Authors:  A Ross Otto; Nathaniel D Daw
Journal:  Neuropsychologia       Date:  2018-05-08       Impact factor: 3.139

6.  A linear threshold model for optimal stopping behavior.

Authors:  Christiane Baumann; Henrik Singmann; Samuel J Gershman; Bettina von Helversen
Journal:  Proc Natl Acad Sci U S A       Date:  2020-05-27       Impact factor: 11.205

7.  Reliability of dissimilarity measures for multi-voxel pattern analysis.

Authors:  Alexander Walther; Hamed Nili; Naveed Ejaz; Arjen Alink; Nikolaus Kriegeskorte; Jörn Diedrichsen
Journal:  Neuroimage       Date:  2015-12-18       Impact factor: 6.556

8.  The macaque anterior cingulate cortex translates counterfactual choice value into actual behavioral change.

Authors:  Elsa F Fouragnan; Bolton K H Chau; Davide Folloni; Jerome Sallet; Matthew F S Rushworth; Nils Kolling; Lennart Verhagen; Miriam Klein-Flügge; Lev Tankelevitch; Georgios K Papageorgiou; Jean-Francois Aubry
Journal:  Nat Neurosci       Date:  2019-04-15       Impact factor: 24.884

9.  A Basal Forebrain-Cingulate Circuit in Macaques Decides It Is Time to Act.

Authors:  Nima Khalighinejad; Alessandro Bongioanni; Lennart Verhagen; Davide Folloni; David Attali; Jean-Francois Aubry; Jerome Sallet; Matthew F S Rushworth
Journal:  Neuron       Date:  2019-12-05       Impact factor: 17.173

10.  Expectations of reward and efficacy guide cognitive control allocation.

Authors:  R Frömer; H Lin; C K Dean Wolf; M Inzlicht; A Shenhav
Journal:  Nat Commun       Date:  2021-02-15       Impact factor: 14.919

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.