Literature DB >> 30289167

The Outcome-Representation Learning Model: A Novel Reinforcement Learning Model of the Iowa Gambling Task.

Nathaniel Haines1, Jasmin Vassileva2,3, Woo-Young Ahn1,4.   

Abstract

The Iowa Gambling Task (IGT) is widely used to study decision-making within healthy and psychiatric populations. However, the complexity of the IGT makes it difficult to attribute variation in performance to specific cognitive processes. Several cognitive models have been proposed for the IGT in an effort to address this problem, but currently no single model shows optimal performance for both short- and long-term prediction accuracy and parameter recovery. Here, we propose the Outcome-Representation Learning (ORL) model, a novel model that provides the best compromise between competing models. We test the performance of the ORL model on 393 subjects' data collected across multiple research sites, and we show that the ORL reveals distinct patterns of decision-making in substance-using populations. Our work highlights the importance of using multiple model comparison metrics to make valid inference with cognitive models and sheds light on learning mechanisms that play a role in underweighting of rare events.
© 2018 Cognitive Science Society, Inc.

Entities:  

Keywords:  Amphetamine; Bayesian data analysis; Cannabis; Computational modeling; Heroin; Iowa Gambling Task; Reinforcement learning; Substance use

Mesh:

Year:  2018        PMID: 30289167      PMCID: PMC6286201          DOI: 10.1111/cogs.12688

Source DB:  PubMed          Journal:  Cogn Sci        ISSN: 0364-0213


  54 in total

1.  Decision-making deficits, linked to a dysfunctional ventromedial prefrontal cortex, revealed in alcohol and stimulant abusers.

Authors:  A Bechara; S Dolan; N Denburg; A Hindes; S W Anderson; P E Nathan
Journal:  Neuropsychologia       Date:  2001       Impact factor: 3.139

2.  Application of stochastic modeling to the assessment of group and individual differences in cognitive functioning.

Authors:  Richard W J Neufeld; David Vollick; Jeffrey R Carter; Kristine Boksman; Jennifer Jetté
Journal:  Psychol Assess       Date:  2002-09

Review 3.  Computational modeling for addiction medicine: From cognitive models to clinical applications.

Authors:  Woo Young Ahn; Junyi Dai; Jasmin Vassileva; Jerome R Busemeyer; Julie C Stout
Journal:  Prog Brain Res       Date:  2015-11-04       Impact factor: 2.453

4.  Acute marijuana effects on human risk taking.

Authors:  Scott D Lane; Don R Cherek; Oleg V Tcheremissine; Lori M Lieving; Cythia J Pietras
Journal:  Neuropsychopharmacology       Date:  2005-04       Impact factor: 7.853

5.  What we regret most... and why.

Authors:  Neal J Roese; Amy Summerville
Journal:  Pers Soc Psychol Bull       Date:  2005-09

6.  Relationship between impulsivity and decision making in cocaine dependence.

Authors:  Kimberly L Kjome; Scott D Lane; Joy M Schmitz; Charles Green; Liangsuo Ma; Irshad Prasla; Alan C Swann; F Gerard Moeller
Journal:  Psychiatry Res       Date:  2010-05-15       Impact factor: 3.222

7.  A survey of model evaluation approaches with a tutorial on hierarchical bayesian methods.

Authors:  Richard M Shiffrin; Michael D Lee; Woojae Kim; Eric-Jan Wagenmakers
Journal:  Cogn Sci       Date:  2008-12

8.  Decision-making and addiction (part I): impaired activation of somatic states in substance dependent individuals when pondering decisions with negative future consequences.

Authors:  Antoine Bechara; Hanna Damasio
Journal:  Neuropsychologia       Date:  2002       Impact factor: 3.139

9.  Interactions Among Working Memory, Reinforcement Learning, and Effort in Value-Based Choice: A New Paradigm and Selective Deficits in Schizophrenia.

Authors:  Anne G E Collins; Matthew A Albrecht; James A Waltz; James M Gold; Michael J Frank
Journal:  Biol Psychiatry       Date:  2017-05-31       Impact factor: 13.382

Review 10.  The description-experience gap in risky choice.

Authors:  Ralph Hertwig; Ido Erev
Journal:  Trends Cogn Sci       Date:  2009-10-14       Impact factor: 20.229

View more
  13 in total

1.  Using reinforcement learning models in social neuroscience: frameworks, pitfalls and suggestions of best practices.

Authors:  Lei Zhang; Lukas Lengersdorff; Nace Mikus; Jan Gläscher; Claus Lamm
Journal:  Soc Cogn Affect Neurosci       Date:  2020-07-30       Impact factor: 3.436

Review 2.  Moving beyond Ordinary Factor Analysis in Studies of Personality and Personality Disorder: A Computational Modeling Perspective.

Authors:  Nathaniel Haines; Theodore P Beauchaine
Journal:  Psychopathology       Date:  2020-07-14       Impact factor: 1.944

3.  Shuffle the Decks: Children Are Sensitive to Incidental Nonrandom Structure in a Sequential-Choice Task.

Authors:  Alexander D S Breslav; Nancy L Zucker; Julia C Schechter; Alesha Majors; Tatyana Bidopia; Bernard F Fuemmeler; Scott H Kollins; Scott A Huettel
Journal:  Psychol Sci       Date:  2022-03-10

4.  Development of a novel computational model for the Balloon Analogue Risk Task: The Exponential-Weight Mean-Variance Model.

Authors:  Harhim Park; Jaeyeong Yang; Jasmin Vassileva; Woo-Young Ahn
Journal:  J Math Psychol       Date:  2021-04-21       Impact factor: 1.387

5.  Computational models of exploration and exploitation characterise onset and efficacy of treatment in methamphetamine use disorder.

Authors:  Alex H Robinson; Trevor T-J Chong; Antonio Verdejo-Garcia
Journal:  Addict Biol       Date:  2022-05       Impact factor: 4.093

6.  Computational Modeling for Neuropsychological Assessment of Bradyphrenia in Parkinson's Disease.

Authors:  Alexander Steinke; Florian Lange; Caroline Seer; Merle K Hendel; Bruno Kopp
Journal:  J Clin Med       Date:  2020-04-18       Impact factor: 4.241

7.  Sequential exploration in the Iowa gambling task: Validation of a new computational model in a large dataset of young and old healthy participants.

Authors:  Romain Ligneul
Journal:  PLoS Comput Biol       Date:  2019-06-13       Impact factor: 4.475

8.  Testing the factor structure underlying behavior using joint cognitive models: Impulsivity in delay discounting and Cambridge gambling tasks.

Authors:  Peter D Kvam; Ricardo J Romeu; Brandon M Turner; Jasmin Vassileva; Jerome R Busemeyer
Journal:  Psychol Methods       Date:  2020-03-05

9.  Parallel model-based and model-free reinforcement learning for card sorting performance.

Authors:  Alexander Steinke; Florian Lange; Bruno Kopp
Journal:  Sci Rep       Date:  2020-09-22       Impact factor: 4.379

10.  Normatively Irrelevant Affective Cues Affect Risk-Taking under Uncertainty: Insights from the Iowa Gambling Task (IGT), Skin Conductance Response, and Heart Rate Variability.

Authors:  Giulia Priolo; Marco D'Alessandro; Andrea Bizzego; Nicolao Bonini
Journal:  Brain Sci       Date:  2021-03-06
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.