Literature DB >> 27656023

Necessary Contributions of Human Frontal Lobe Subregions to Reward Learning in a Dynamic, Multidimensional Environment.

Avinash R Vaidya1, Lesley K Fellows2.   

Abstract

UNLABELLED: Real-world decisions are typically made between options that vary along multiple dimensions, requiring prioritization of the important dimensions to support optimal choice. Learning in this setting depends on attributing decision outcomes to the dimensions with predictive relevance rather than to dimensions that are irrelevant and nonpredictive. This attribution problem is computationally challenging, and likely requires an interplay between selective attention and reward learning. Both these processes have been separately linked to the prefrontal cortex, but little is known about how they combine to support learning the reward value of multidimensional stimuli. Here, we examined the necessary contributions of frontal lobe subregions in attributing feedback to relevant and irrelevant dimensions on a trial-by-trial basis in humans. Patients with focal frontal lobe damage completed a demanding reward learning task where options varied on three dimensions, only one of which predicted reward. Participants with left lateral frontal lobe damage attributed rewards to irrelevant dimensions, rather than the relevant dimension. Damage to the ventromedial frontal lobe also impaired learning about the relevant dimension, but did not increase reward attribution to irrelevant dimensions. The results argue for distinct roles for these two regions in learning the value of multidimensional decision options under dynamic conditions, with the lateral frontal lobe required for selecting the relevant dimension to associate with reward, and the ventromedial frontal lobe required to learn the reward association itself. SIGNIFICANCE STATEMENT: The real world is complex and multidimensional; how do we attribute rewards to predictive features when surrounded by competing cues? Here, we tested the critical involvement of human frontal lobe subregions in a probabilistic, multidimensional learning environment, asking whether focal lesions affected trial-by-trial attribution of feedback to relevant and irrelevant dimensions. The left lateral frontal lobe was required for filtering option dimensions to allow appropriate feedback attribution, while the ventromedial frontal lobe was necessary for learning the value of features in the relevant dimension. These findings argue that selective attention and associative learning processes mediated by anatomically distinct frontal lobe subregions are both critical for adaptive choice in more complex, ecologically valid settings.
Copyright © 2016 the authors 0270-6474/16/369843-16$15.00/0.

Entities:  

Keywords:  associative learning; attention; decision making; frontal lobe; neuropsychology; value

Mesh:

Year:  2016        PMID: 27656023      PMCID: PMC6705570          DOI: 10.1523/JNEUROSCI.1337-16.2016

Source DB:  PubMed          Journal:  J Neurosci        ISSN: 0270-6474            Impact factor:   6.167


  58 in total

1.  fMRI evidence for objects as the units of attentional selection.

Authors:  K M O'Craven; P E Downing; N Kanwisher
Journal:  Nature       Date:  1999-10-07       Impact factor: 49.962

Review 2.  An integrative theory of prefrontal cortex function.

Authors:  E K Miller; J D Cohen
Journal:  Annu Rev Neurosci       Date:  2001       Impact factor: 12.449

3.  Nonparametric permutation tests for functional neuroimaging: a primer with examples.

Authors:  Thomas E Nichols; Andrew P Holmes
Journal:  Hum Brain Mapp       Date:  2002-01       Impact factor: 5.038

4.  The token test: A sensitive test to detect receptive disturbances in aphasics.

Authors:  E DE RENZI; L A VIGNOLO
Journal:  Brain       Date:  1962-12       Impact factor: 13.501

Review 5.  Mirror writing: neurological reflections on an unusual phenomenon.

Authors:  G D Schott
Journal:  J Neurol Neurosurg Psychiatry       Date:  2006-09-08       Impact factor: 10.154

6.  The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment.

Authors:  Ziad S Nasreddine; Natalie A Phillips; Valérie Bédirian; Simon Charbonneau; Victor Whitehead; Isabelle Collin; Jeffrey L Cummings; Howard Chertkow
Journal:  J Am Geriatr Soc       Date:  2005-04       Impact factor: 5.562

7.  Multiple frontal systems controlling response speed.

Authors:  Donald T Stuss; Michael P Alexander; Tim Shallice; Terence W Picton; Malcolm A Binns; Ronald Macdonald; Agnes Borowiec; Douglas I Katz
Journal:  Neuropsychologia       Date:  2005       Impact factor: 3.139

8.  Reward-related reversal learning after surgical excisions in orbito-frontal or dorsolateral prefrontal cortex in humans.

Authors:  J Hornak; J O'Doherty; J Bramham; E T Rolls; R G Morris; P R Bullock; C E Polkey
Journal:  J Cogn Neurosci       Date:  2004-04       Impact factor: 3.225

9.  Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm.

Authors:  Lesley K Fellows; Martha J Farah
Journal:  Brain       Date:  2003-06-23       Impact factor: 13.501

10.  Asymmetry of attentional set in rhesus monkeys learning colour and shape discriminations.

Authors:  Mark G Baxter; David Gaffan
Journal:  Q J Exp Psychol (Hove)       Date:  2007-01       Impact factor: 2.143

View more
  10 in total

1.  Contrasting Effects of Medial and Lateral Orbitofrontal Cortex Lesions on Credit Assignment and Decision-Making in Humans.

Authors:  MaryAnn P Noonan; Bolton K H Chau; Matthew F S Rushworth; Lesley K Fellows
Journal:  J Neurosci       Date:  2017-06-19       Impact factor: 6.167

Review 2.  Specializations for reward-guided decision-making in the primate ventral prefrontal cortex.

Authors:  Elisabeth A Murray; Peter H Rudebeck
Journal:  Nat Rev Neurosci       Date:  2018-07       Impact factor: 34.870

3.  Ventromedial Frontal Lobe Damage Alters how Specific Attributes are Weighed in Subjective Valuation.

Authors:  Avinash R Vaidya; Marcus Sefranek; Lesley K Fellows
Journal:  Cereb Cortex       Date:  2018-11-01       Impact factor: 5.357

4.  A Critical Role for Human Ventromedial Frontal Lobe in Value Comparison of Complex Objects Based on Attribute Configuration.

Authors:  Gabriel Pelletier; Lesley K Fellows
Journal:  J Neurosci       Date:  2019-03-13       Impact factor: 6.167

5.  Specialized Representations of Value in the Orbital and Ventrolateral Prefrontal Cortex: Desirability versus Availability of Outcomes.

Authors:  Peter H Rudebeck; Richard C Saunders; Dawn A Lundgren; Elisabeth A Murray
Journal:  Neuron       Date:  2017-08-30       Impact factor: 17.173

Review 6.  Under construction: ventral and lateral frontal lobe contributions to value-based decision-making and learning.

Authors:  Avinash R Vaidya; Lesley K Fellows
Journal:  F1000Res       Date:  2020-02-28

7.  Ventromedial prefrontal cortex compression during concept learning.

Authors:  Michael L Mack; Alison R Preston; Bradley C Love
Journal:  Nat Commun       Date:  2020-01-07       Impact factor: 14.919

8.  Experimentally revealed stochastic preferences for multicomponent choice options.

Authors:  Alexandre Pastor-Bernier; Konstantin Volkmann; Arkadiusz Stasiak; Fabian Grabenhorst; Wolfram Schultz
Journal:  J Exp Psychol Anim Learn Cogn       Date:  2020-07-27       Impact factor: 2.478

Review 9.  Prefrontal cortex interactions with the amygdala in primates.

Authors:  Elisabeth A Murray; Lesley K Fellows
Journal:  Neuropsychopharmacology       Date:  2021-08-26       Impact factor: 7.853

Review 10.  Understanding psychiatric disorder by capturing ecologically relevant features of learning and decision-making.

Authors:  Jacqueline Scholl; Miriam Klein-Flügge
Journal:  Behav Brain Res       Date:  2017-09-28       Impact factor: 3.332

  10 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.