Literature DB >> 24324166

Working-memory capacity protects model-based learning from stress.

A Ross Otto1, Candace M Raio, Alice Chiang, Elizabeth A Phelps, Nathaniel D Daw.   

Abstract

Accounts of decision-making have long posited the operation of separate, competing valuation systems in the control of choice behavior. Recent theoretical and experimental advances suggest that this classic distinction between habitual and goal-directed (or more generally, automatic and controlled) choice may arise from two computational strategies for reinforcement learning, called model-free and model-based learning. Popular neurocomputational accounts of reward processing emphasize the involvement of the dopaminergic system in model-free learning and prefrontal, central executive-dependent control systems in model-based choice. Here we hypothesized that the hypothalamic-pituitary-adrenal (HPA) axis stress response--believed to have detrimental effects on prefrontal cortex function--should selectively attenuate model-based contributions to behavior. To test this, we paired an acute stressor with a sequential decision-making task that affords distinguishing the relative contributions of the two learning strategies. We assessed baseline working-memory (WM) capacity and used salivary cortisol levels to measure HPA axis stress response. We found that stress response attenuates the contribution of model-based, but not model-free, contributions to behavior. Moreover, stress-induced behavioral changes were modulated by individual WM capacity, such that low-WM-capacity individuals were more susceptible to detrimental stress effects than high-WM-capacity individuals. These results enrich existing accounts of the interplay between acute stress, working memory, and prefrontal function and suggest that executive function may be protective against the deleterious effects of acute stress.

Entities:  

Mesh:

Substances:

Year:  2013        PMID: 24324166      PMCID: PMC3876216          DOI: 10.1073/pnas.1312011110

Source DB:  PubMed          Journal:  Proc Natl Acad Sci U S A        ISSN: 0027-8424            Impact factor:   11.205


  44 in total

1.  Anticipatory stress influences decision making under explicit risk conditions.

Authors:  Katrin Starcke; Oliver T Wolf; Hans J Markowitsch; Matthias Brand
Journal:  Behav Neurosci       Date:  2008-12       Impact factor: 1.912

Review 2.  A neural substrate of prediction and reward.

Authors:  W Schultz; P Dayan; P R Montague
Journal:  Science       Date:  1997-03-14       Impact factor: 47.728

3.  Glucocorticoid receptors in the prefrontal cortex regulate stress-evoked dopamine efflux and aspects of executive function.

Authors:  Kelly A Butts; Joanne Weinberg; Allan H Young; Anthony G Phillips
Journal:  Proc Natl Acad Sci U S A       Date:  2011-10-27       Impact factor: 11.205

Review 4.  Decision making under stress: a selective review.

Authors:  Katrin Starcke; Matthias Brand
Journal:  Neurosci Biobehav Rev       Date:  2012-02-10       Impact factor: 8.989

5.  Differential effect of stress on in vivo dopamine release in striatum, nucleus accumbens, and medial frontal cortex.

Authors:  E D Abercrombie; K A Keefe; D S DiFrischia; M J Zigmond
Journal:  J Neurochem       Date:  1989-05       Impact factor: 5.372

6.  Stress modulates reinforcement learning in younger and older adults.

Authors:  Nichole R Lighthall; Marissa A Gorlick; Andrej Schoeke; Michael J Frank; Mara Mather
Journal:  Psychol Aging       Date:  2012-09-03

Review 7.  Cognitive reserve.

Authors:  Yaakov Stern
Journal:  Neuropsychologia       Date:  2009-03-13       Impact factor: 3.139

Review 8.  Neural systems of reinforcement for drug addiction: from actions to habits to compulsion.

Authors:  Barry J Everitt; Trevor W Robbins
Journal:  Nat Neurosci       Date:  2005-11       Impact factor: 24.884

Review 9.  A unified framework for addiction: vulnerabilities in the decision process.

Authors:  A David Redish; Steve Jensen; Adam Johnson
Journal:  Behav Brain Sci       Date:  2008-08       Impact factor: 21.357

10.  Disruption of dorsolateral prefrontal cortex decreases model-based in favor of model-free control in humans.

Authors:  Peter Smittenaar; Thomas H B FitzGerald; Vincenzo Romei; Nicholas D Wright; Raymond J Dolan
Journal:  Neuron       Date:  2013-10-24       Impact factor: 17.173

View more
  145 in total

Review 1.  The neural bases of emotion regulation.

Authors:  Amit Etkin; Christian Büchel; James J Gross
Journal:  Nat Rev Neurosci       Date:  2015-11       Impact factor: 34.870

2.  Evidence integration in model-based tree search.

Authors:  Alec Solway; Matthew M Botvinick
Journal:  Proc Natl Acad Sci U S A       Date:  2015-08-31       Impact factor: 11.205

3.  Recent Developments in the Habit Hypothesis of OCD and Compulsive Disorders.

Authors:  Claire M Gillan
Journal:  Curr Top Behav Neurosci       Date:  2021

4.  Selective maintenance of value information helps resolve the exploration/exploitation dilemma.

Authors:  Michael N Hallquist; Alexandre Y Dombrovski
Journal:  Cognition       Date:  2018-11-28

Review 5.  Dual-process theory, conflict processing, and delusional belief.

Authors:  Michael V Bronstein; Gordon Pennycook; Jutta Joormann; Philip R Corlett; Tyrone D Cannon
Journal:  Clin Psychol Rev       Date:  2019-06-12

6.  Stress and Decision Making: Effects on Valuation, Learning, and Risk-taking.

Authors:  Anthony J Porcelli; Mauricio R Delgado
Journal:  Curr Opin Behav Sci       Date:  2017-04

Review 7.  Age-related variability in decision-making: Insights from neurochemistry.

Authors:  Anne S Berry; William J Jagust; Ming Hsu
Journal:  Cogn Affect Behav Neurosci       Date:  2019-06       Impact factor: 3.282

8.  Motivational Context Modulates Prediction Error Response in Schizophrenia.

Authors:  Jenna M Reinen; Jared X Van Snellenberg; Guillermo Horga; Anissa Abi-Dargham; Nathaniel D Daw; Daphna Shohamy
Journal:  Schizophr Bull       Date:  2016-04-22       Impact factor: 9.306

Review 9.  Exploration versus exploitation in space, mind, and society.

Authors:  Thomas T Hills; Peter M Todd; David Lazer; A David Redish; Iain D Couzin
Journal:  Trends Cogn Sci       Date:  2014-12-03       Impact factor: 20.229

10.  Improving the Reliability of Computational Analyses: Model-Based Planning and Its Relationship With Compulsivity.

Authors:  Vanessa M Brown; Jiazhou Chen; Claire M Gillan; Rebecca B Price
Journal:  Biol Psychiatry Cogn Neurosci Neuroimaging       Date:  2020-01-13
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.