Literature DB >> 31125913

Addiction beyond pharmacological effects: The role of environment complexity and bounded rationality.

Dimitri Ognibene1, Vincenzo G Fiore2, Xiaosi Gu3.   

Abstract

Several decision-making vulnerabilities have been identified as underlying causes for addictive behaviours, or the repeated execution of stereotyped actions despite their adverse consequences. These vulnerabilities are mostly associated with brain alterations caused by the consumption of substances of abuse. However, addiction can also happen in the absence of a pharmacological component, such as seen in pathological gambling and videogaming. We use a new reinforcement learning model to highlight a previously neglected vulnerability that we suggest interacts with those already identified, whilst playing a prominent role in non-pharmacological forms of addiction. Specifically, we show that a dual-learning system (i.e. combining model-based and model-free) can be vulnerable to highly rewarding, but suboptimal actions, that are followed by a complex ramification of stochastic adverse effects. This phenomenon is caused by the overload of the capabilities of an agent, as time and cognitive resources required for exploration, deliberation, situation recognition, and habit formation, all increase as a function of the depth and richness of detail of an environment. Furthermore, the cognitive overload can be aggravated due to alterations (e.g. caused by stress) in the bounded rationality, i.e. the limited amount of resources available for the model-based component, in turn increasing the agent's chances to develop or maintain addictive behaviours. Our study demonstrates that, independent of drug consumption, addictive behaviours can arise in the interaction between the environmental complexity and the biologically finite resources available to explore and represent it.
Copyright © 2019 Elsevier Ltd. All rights reserved.

Entities:  

Keywords:  Addiction; Bounded rationality; Computational psychiatry; Exploration–exploitation; Gambling; Internet gaming; Reinforcement learning

Mesh:

Year:  2019        PMID: 31125913      PMCID: PMC6581592          DOI: 10.1016/j.neunet.2019.04.022

Source DB:  PubMed          Journal:  Neural Netw        ISSN: 0893-6080


  59 in total

Review 1.  Drug addiction as dopamine-dependent associative learning disorder.

Authors:  G Di Chiara
Journal:  Eur J Pharmacol       Date:  1999-06-30       Impact factor: 4.432

2.  Reinforcement learning in continuous time and space.

Authors:  K Doya
Journal:  Neural Comput       Date:  2000-01       Impact factor: 2.026

Review 3.  Toward a behavioral economic understanding of drug dependence: delay discounting processes.

Authors:  W K Bickel; L A Marsch
Journal:  Addiction       Date:  2001-01       Impact factor: 6.526

4.  Temporal difference models and reward-related learning in the human brain.

Authors:  John P O'Doherty; Peter Dayan; Karl Friston; Hugo Critchley; Raymond J Dolan
Journal:  Neuron       Date:  2003-04-24       Impact factor: 17.173

5.  Rational choice and the structure of the environment.

Authors:  H A SIMON
Journal:  Psychol Rev       Date:  1956-03       Impact factor: 8.934

6.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control.

Authors:  Nathaniel D Daw; Yael Niv; Peter Dayan
Journal:  Nat Neurosci       Date:  2005-11-06       Impact factor: 24.884

7.  Addiction as a computational process gone awry.

Authors:  A David Redish
Journal:  Science       Date:  2004-12-10       Impact factor: 47.728

8.  Midbrain dopamine neurons encode a quantitative reward prediction error signal.

Authors:  Hannah M Bayer; Paul W Glimcher
Journal:  Neuron       Date:  2005-07-07       Impact factor: 17.173

9.  Social support and relapse: commonalities among alcoholics, opiate users, and cigarette smokers.

Authors:  B E Havassy; S M Hall; D A Wasserman
Journal:  Addict Behav       Date:  1991       Impact factor: 3.913

10.  Temporal prediction errors in a passive learning task activate human striatum.

Authors:  Samuel M McClure; Gregory S Berns; P Read Montague
Journal:  Neuron       Date:  2003-04-24       Impact factor: 17.173

View more
  2 in total

1.  Rigid reduced successor representation as a potential mechanism for addiction.

Authors:  Kanji Shimomura; Ayaka Kato; Kenji Morita
Journal:  Eur J Neurosci       Date:  2021-05-10       Impact factor: 3.386

2.  Similar network compositions, but distinct neural dynamics underlying belief updating in environments with and without explicit outcomes.

Authors:  Vincenzo G Fiore; Xiaosi Gu
Journal:  Neuroimage       Date:  2021-12-14       Impact factor: 7.400

  2 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.