Literature DB >> 28416682

Computational modeling of epiphany learning.

Wei James Chen1, Ian Krajbich2,3.   

Abstract

Models of reinforcement learning (RL) are prevalent in the decision-making literature, but not all behavior seems to conform to the gradual convergence that is a central feature of RL. In some cases learning seems to happen all at once. Limited prior research on these "epiphanies" has shown evidence of sudden changes in behavior, but it remains unclear how such epiphanies occur. We propose a sequential-sampling model of epiphany learning (EL) and test it using an eye-tracking experiment. In the experiment, subjects repeatedly play a strategic game that has an optimal strategy. Subjects can learn over time from feedback but are also allowed to commit to a strategy at any time, eliminating all other options and opportunities to learn. We find that the EL model is consistent with the choices, eye movements, and pupillary responses of subjects who commit to the optimal strategy (correct epiphany) but not always of those who commit to a suboptimal strategy or who do not commit at all. Our findings suggest that EL is driven by a latent evidence accumulation process that can be revealed with eye-tracking data.

Entities:  

Keywords:  beauty contest; decision making; epiphany learning; eye tracking; pupil dilation

Mesh:

Year:  2017        PMID: 28416682      PMCID: PMC5422778          DOI: 10.1073/pnas.1618161114

Source DB:  PubMed          Journal:  Proc Natl Acad Sci U S A        ISSN: 0027-8424            Impact factor:   11.205


  23 in total

1.  A comparison of sequential sampling models for two-choice reaction time.

Authors:  Roger Ratcliff; Philip L Smith
Journal:  Psychol Rev       Date:  2004-04       Impact factor: 8.934

2.  Visual fixations and the computation and comparison of value in simple choice.

Authors:  Ian Krajbich; Carrie Armel; Antonio Rangel
Journal:  Nat Neurosci       Date:  2010-09-12       Impact factor: 24.884

Review 3.  The diffusion decision model: theory and data for two-choice decision tasks.

Authors:  Roger Ratcliff; Gail McKoon
Journal:  Neural Comput       Date:  2008-04       Impact factor: 2.026

4.  Intuition in insight and noninsight problem solving.

Authors:  J Metcalfe; D Wiebe
Journal:  Mem Cognit       Date:  1987-05

Review 5.  Reward, motivation, and reinforcement learning.

Authors:  Peter Dayan; Bernard W Balleine
Journal:  Neuron       Date:  2002-10-10       Impact factor: 17.173

6.  Eye tracking and pupillometry are indicators of dissociable latent decision processes.

Authors:  James F Cavanagh; Thomas V Wiecki; Angad Kochar; Michael J Frank
Journal:  J Exp Psychol Gen       Date:  2014-02-17

7.  Pupil Dilation Signals Surprise: Evidence for Noradrenaline's Role in Decision Making.

Authors:  Kerstin Preuschoff; Bernard Marius 't Hart; Wolfgang Einhäuser
Journal:  Front Neurosci       Date:  2011-09-30       Impact factor: 4.677

8.  Rational regulation of learning dynamics by pupil-linked arousal systems.

Authors:  Matthew R Nassar; Katherine M Rumsey; Robert C Wilson; Kinjan Parikh; Benjamin Heasly; Joshua I Gold
Journal:  Nat Neurosci       Date:  2012-06-03       Impact factor: 24.884

9.  Revisiting the learning curve (once again).

Authors:  Steven Glautier
Journal:  Front Psychol       Date:  2013-12-26

10.  Eye Movements in Strategic Choice.

Authors:  Neil Stewart; Simon Gächter; Takao Noguchi; Timothy L Mullett
Journal:  J Behav Decis Mak       Date:  2015-10-29
View more
  1 in total

Review 1.  Adaptive learning under expected and unexpected uncertainty.

Authors:  Alireza Soltani; Alicia Izquierdo
Journal:  Nat Rev Neurosci       Date:  2019-10       Impact factor: 34.870

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.