Literature DB >> 33643103

Understanding Human Decision Making in an Interactive Landslide Simulator Tool via Reinforcement Learning.

Pratik Chaturvedi1,2, Varun Dutt1.   

Abstract

Prior research has used an Interactive Landslide Simulator (ILS) tool to investigate human decision making against landslide risks. It has been found that repeated feedback in the ILS tool about damages due to landslides causes an improvement in human decisions against landslide risks. However, little is known on how theories of learning from feedback (e.g., reinforcement learning) would account for human decisions in the ILS tool. The primary goal of this paper is to account for human decisions in the ILS tool via computational models based upon reinforcement learning and to explore the model mechanisms involved when people make decisions in the ILS tool. Four different reinforcement-learning models were developed and evaluated in their ability to capture human decisions in an experiment involving two conditions in the ILS tool. The parameters of an Expectancy-Valence (EV) model, two Prospect-Valence-Learning models (PVL and PVL-2), a combination EV-PU model, and a random model were calibrated to human decisions in the ILS tool across the two conditions. Later, different models with their calibrated parameters were generalized to data collected in an experiment involving a new condition in ILS. When generalized to this new condition, the PVL-2 model's parameters of both damage-feedback conditions outperformed all other RL models (including the random model). We highlight the implications of our results for decision making against landslide risks.
Copyright © 2021 Chaturvedi and Dutt.

Entities:  

Keywords:  damage-feedback; decision-making; expectancy-valence model; interactive landslide simulator; prospect-valence-learning model; reinforcement learning

Year:  2021        PMID: 33643103      PMCID: PMC7902924          DOI: 10.3389/fpsyg.2020.499422

Source DB:  PubMed          Journal:  Front Psychol        ISSN: 1664-1078


  14 in total

1.  Model Comparisons and Model Selections Based on Generalization Criterion Methodology.

Authors: 
Journal:  J Math Psychol       Date:  2000-03       Impact factor: 2.223

2.  Using cognitive models to map relations between neuropsychological disorders and human decision-making deficits.

Authors:  Eldad Yechiam; Jerome R Busemeyer; Julie C Stout; Antoine Bechara
Journal:  Psychol Sci       Date:  2005-12

3.  Mental models of flash floods and landslides.

Authors:  Klaus Wagner
Journal:  Risk Anal       Date:  2007-06       Impact factor: 4.000

4.  Cyber situation awareness: modeling detection of cyber attacks with instance-based learning theory.

Authors:  Varun Dutt; Young-Suk Ahn; Cleotilde Gonzalez
Journal:  Hum Factors       Date:  2013-06       Impact factor: 2.888

5.  Cortical substrates for exploratory decisions in humans.

Authors:  Nathaniel D Daw; John P O'Doherty; Peter Dayan; Ben Seymour; Raymond J Dolan
Journal:  Nature       Date:  2006-06-15       Impact factor: 49.962

Review 6.  Instance-based learning: integrating sampling and repeated decisions from experience.

Authors:  Cleotilde Gonzalez; Varun Dutt
Journal:  Psychol Rev       Date:  2011-10       Impact factor: 8.934

7.  Comparison of decision learning models using the generalization criterion method.

Authors:  Woo-Young Ahn; Jerome R Busemeyer; Eric-Jan Wagenmakers; Julie C Stout
Journal:  Cogn Sci       Date:  2008-12

8.  Dissociable roles of ventral and dorsal striatum in instrumental conditioning.

Authors:  John O'Doherty; Peter Dayan; Johannes Schultz; Ralf Deichmann; Karl Friston; Raymond J Dolan
Journal:  Science       Date:  2004-04-16       Impact factor: 47.728

9.  The role of inertia in modeling decisions from experience with instance-based learning.

Authors:  Varun Dutt; Cleotilde Gonzalez
Journal:  Front Psychol       Date:  2012-06-06

10.  An improved cognitive model of the Iowa and Soochow Gambling Tasks with regard to model fitting performance and tests of parameter consistency.

Authors:  Junyi Dai; Rebecca Kerestes; Daniel J Upton; Jerome R Busemeyer; Julie C Stout
Journal:  Front Psychol       Date:  2015-03-12
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.