Literature DB >> 32801113

Imprecise action selection in substance use disorder: Evidence for active learning impairments when solving the explore-exploit dilemma.

Ryan Smith1, Philipp Schwartenbeck2, Jennifer L Stewart3, Rayus Kuplicki3, Hamed Ekhtiari3, Martin P Paulus3.   

Abstract

BACKGROUND: Substance use disorders (SUDs) are a major public health risk. However, mechanisms accounting for continued patterns of poor choices in the face of negative life consequences remain poorly understood.
METHODS: We use a computational (active inference) modeling approach, combined with multiple regression and hierarchical Bayesian group analyses, to examine how treatment-seeking individuals with one or more SUDs (alcohol, cannabis, sedatives, stimulants, hallucinogens, and/or opioids; N = 147) and healthy controls (HCs; N = 54) make choices to resolve uncertainty within a gambling task. A subset of SUDs (N = 49) and HCs (N = 51) propensity-matched on age, sex, and verbal IQ were also compared to replicate larger group findings.
RESULTS: Results indicate that: (a) SUDs show poorer task performance than HCs (p = 0.03, Cohen's d = 0.33), with model estimates revealing less precise action selection mechanisms (p = 0.004, d = 0.43), a lower learning rate from losses (p = 0.02, d = 0.36), and a greater learning rate from gains (p = 0.04, d = 0.31); and (b) groups do not differ significantly in goal-directed information seeking.
CONCLUSIONS: Findings suggest a pattern of inconsistent behavior in response to positive outcomes in SUDs combined with a tendency to attribute negative outcomes to chance. Specifically, individuals with SUDs fail to settle on a behavior strategy despite sufficient evidence of its success. These learning impairments could help account for difficulties in adjusting behavior and maintaining optimal decision-making during and after treatment.
Copyright © 2020 Elsevier B.V. All rights reserved.

Entities:  

Keywords:  Active inference; Computational modeling; Directed exploration; Explore-exploit dilemma; Learning rate; Substance use disorders

Year:  2020        PMID: 32801113      PMCID: PMC7502502          DOI: 10.1016/j.drugalcdep.2020.108208

Source DB:  PubMed          Journal:  Drug Alcohol Depend        ISSN: 0376-8716            Impact factor:   4.492


  51 in total

1.  Variational free energy and the Laplace approximation.

Authors:  Karl Friston; Jérémie Mattout; Nelson Trujillo-Barreto; John Ashburner; Will Penny
Journal:  Neuroimage       Date:  2006-10-20       Impact factor: 6.556

2.  Bayesian model selection for group studies - revisited.

Authors:  L Rigoux; K E Stephan; K J Friston; J Daunizeau
Journal:  Neuroimage       Date:  2013-09-07       Impact factor: 6.556

3.  Pharmaceutical overdose deaths, United States, 2010.

Authors:  Christopher M Jones; Karin A Mack; Leonard J Paulozzi
Journal:  JAMA       Date:  2013-02-20       Impact factor: 56.272

4.  Development and validation of an Overall Anxiety Severity And Impairment Scale (OASIS).

Authors:  Sonya B Norman; Shadha Hami Cissell; Adrienne J Means-Christensen; Murray B Stein
Journal:  Depress Anxiety       Date:  2006       Impact factor: 6.505

5.  The PHQ-9: validity of a brief depression severity measure.

Authors:  K Kroenke; R L Spitzer; J B Williams
Journal:  J Gen Intern Med       Date:  2001-09       Impact factor: 5.128

6.  The influence of monetary punishment on cognitive control in abstinent cocaine-users.

Authors:  Robert Hester; Ryan P Bell; John J Foxe; Hugh Garavan
Journal:  Drug Alcohol Depend       Date:  2013-06-21       Impact factor: 4.492

7.  Neuropsychological predictors of clinical outcome in opiate addiction.

Authors:  F Passetti; L Clark; M A Mehta; E Joyce; M King
Journal:  Drug Alcohol Depend       Date:  2007-12-11       Impact factor: 4.492

8.  Bayesian model selection for group studies.

Authors:  Klaas Enno Stephan; Will D Penny; Jean Daunizeau; Rosalyn J Moran; Karl J Friston
Journal:  Neuroimage       Date:  2009-03-20       Impact factor: 6.556

9.  Decision-making in stimulant and opiate addicts in protracted abstinence: evidence from computational modeling with pure users.

Authors:  Woo-Young Ahn; Georgi Vasilev; Sung-Ha Lee; Jerome R Busemeyer; John K Kruschke; Antoine Bechara; Jasmin Vassileva
Journal:  Front Psychol       Date:  2014-08-12

10.  Tulsa 1000: a naturalistic study protocol for multilevel assessment and outcome prediction in a large psychiatric sample.

Authors:  Teresa A Victor; Sahib S Khalsa; W Kyle Simmons; Justin S Feinstein; Jonathan Savitz; Robin L Aupperle; Hung-Wen Yeh; Jerzy Bodurka; Martin P Paulus
Journal:  BMJ Open       Date:  2018-01-24       Impact factor: 2.692

View more
  11 in total

Review 1.  Reinforcement learning detuned in addiction: integrative and translational approaches.

Authors:  Stephanie M Groman; Summer L Thompson; Daeyeol Lee; Jane R Taylor
Journal:  Trends Neurosci       Date:  2021-12-15       Impact factor: 13.837

2.  A step-by-step tutorial on active inference and its application to empirical data.

Authors:  Ryan Smith; Karl J Friston; Christopher J Whyte
Journal:  J Math Psychol       Date:  2022-02-04       Impact factor: 1.387

3.  The experimental tobacco marketplace: Effects of low-ventilated cigarette exposure.

Authors:  Roberta Freitas-Lemos; Allison N Tegge; Jeffrey S Stein; William Brady DeHart; Sarah A Reisinger; Peter G Shields; Dorothy K Hatsukami; Warren K Bickel
Journal:  Addict Behav       Date:  2021-10-19       Impact factor: 4.591

4.  Active inference and the two-step task.

Authors:  Sam Gijsen; Miro Grundei; Felix Blankenburg
Journal:  Sci Rep       Date:  2022-10-21       Impact factor: 4.996

5.  Computational models of exploration and exploitation characterise onset and efficacy of treatment in methamphetamine use disorder.

Authors:  Alex H Robinson; Trevor T-J Chong; Antonio Verdejo-Garcia
Journal:  Addict Biol       Date:  2022-05       Impact factor: 4.093

6.  Perceptual insensitivity to the modulation of interoceptive signals in depression, anxiety, and substance use disorders.

Authors:  Ryan Smith; Justin S Feinstein; Rayus Kuplicki; Katherine L Forthman; Jennifer L Stewart; Martin P Paulus; Sahib S Khalsa
Journal:  Sci Rep       Date:  2021-01-22       Impact factor: 4.996

Review 7.  Active inference on discrete state-spaces: A synthesis.

Authors:  Lancelot Da Costa; Thomas Parr; Noor Sajid; Sebastijan Veselic; Victorita Neacsu; Karl Friston
Journal:  J Math Psychol       Date:  2020-12       Impact factor: 2.223

8.  Long-term stability of computational parameters during approach-avoidance conflict in a transdiagnostic psychiatric patient sample.

Authors:  Ryan Smith; Namik Kirlic; Jennifer L Stewart; James Touthang; Rayus Kuplicki; Timothy J McDermott; Samuel Taylor; Sahib S Khalsa; Martin P Paulus; Robin L Aupperle
Journal:  Sci Rep       Date:  2021-06-03       Impact factor: 4.379

9.  Lower Levels of Directed Exploration and Reflective Thinking Are Associated With Greater Anxiety and Depression.

Authors:  Ryan Smith; Samuel Taylor; Robert C Wilson; Anne E Chuning; Michelle R Persich; Siyu Wang; William D S Killgore
Journal:  Front Psychiatry       Date:  2022-01-07       Impact factor: 4.157

10.  Gut inference: A computational modelling approach.

Authors:  Ryan Smith; Ahmad Mayeli; Samuel Taylor; Obada Al Zoubi; Jessyca Naegele; Sahib S Khalsa
Journal:  Biol Psychol       Date:  2021-07-24       Impact factor: 3.251

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.