Literature DB >> 29095819

A Rescorla-Wagner drift-diffusion model of conditioning and timing.

André Luzardo1,2, Eduardo Alonso1,2, Esther Mondragón1,2.   

Abstract

Computational models of classical conditioning have made significant contributions to the theoretic understanding of associative learning, yet they still struggle when the temporal aspects of conditioning are taken into account. Interval timing models have contributed a rich variety of time representations and provided accurate predictions for the timing of responses, but they usually have little to say about associative learning. In this article we present a unified model of conditioning and timing that is based on the influential Rescorla-Wagner conditioning model and the more recently developed Timing Drift-Diffusion model. We test the model by simulating 10 experimental phenomena and show that it can provide an adequate account for 8, and a partial account for the other 2. We argue that the model can account for more phenomena in the chosen set than these other similar in scope models: CSC-TD, MS-TD, Learning to Time and Modular Theory. A comparison and analysis of the mechanisms in these models is provided, with a focus on the types of time representation and associative learning rule used.

Entities:  

Mesh:

Year:  2017        PMID: 29095819      PMCID: PMC5685643          DOI: 10.1371/journal.pcbi.1005796

Source DB:  PubMed          Journal:  PLoS Comput Biol        ISSN: 1553-734X            Impact factor:   4.475


  83 in total

1.  Retrospective and prospective coding for predicted reward in the sensory thalamus.

Authors:  Y Komura; R Tamura; T Uwano; H Nishijo; K Kaga; T Ono
Journal:  Nature       Date:  2001-08-02       Impact factor: 49.962

2.  A two-state analysis of fixed-interval responding in the pigeon.

Authors:  B A Schneider
Journal:  J Exp Anal Behav       Date:  1969-09       Impact factor: 2.468

3.  A modular theory of learning and performance.

Authors:  Paulo Guilhardi; Linun Yi; Russell M Church
Journal:  Psychon Bull Rev       Date:  2007-08

Review 4.  Diffusion models in experimental psychology: a practical introduction.

Authors:  Andreas Voss; Markus Nagler; Veronika Lerche
Journal:  Exp Psychol       Date:  2013

Review 5.  Properties of the internal clock: first- and second-order principles of subjective time.

Authors:  Melissa J Allman; Sundeep Teki; Timothy D Griffiths; Warren H Meck
Journal:  Annu Rev Psychol       Date:  2013-09-11       Impact factor: 24.137

Review 6.  A neural substrate of prediction and reward.

Authors:  W Schultz; P Dayan; P R Montague
Journal:  Science       Date:  1997-03-14       Impact factor: 47.728

7.  Pavlovian conditioning. It's not what you think it is.

Authors:  R A Rescorla
Journal:  Am Psychol       Date:  1988-03

8.  Time as content in Pavlovian conditioning.

Authors:  H I Savastano; R R Miller
Journal:  Behav Processes       Date:  1998-12       Impact factor: 1.777

9.  Temporal encoding as a determinant of blocking.

Authors:  R C Barnet; N J Grahame; R R Miller
Journal:  J Exp Psychol Anim Behav Process       Date:  1993-10

10.  Averaging of temporal memories by rats.

Authors:  Dale N Swanton; Cynthia M Gooch; Matthew S Matell
Journal:  J Exp Psychol Anim Behav Process       Date:  2009-07
View more
  9 in total

1.  Time-scale-invariant information-theoretic contingencies in discrimination learning.

Authors:  Abigail Kalmbach; Eileen Chun; Kathleen Taylor; Charles R Gallistel; Peter D Balsam
Journal:  J Exp Psychol Anim Learn Cogn       Date:  2019-04-25       Impact factor: 2.478

2.  Adapting the flow of time with dopamine.

Authors:  John G Mikhael; Samuel J Gershman
Journal:  J Neurophysiol       Date:  2019-03-13       Impact factor: 2.714

3.  Reinforcement learning with associative or discriminative generalization across states and actions: fMRI at 3 T and 7 T.

Authors:  Jaron T Colas; Neil M Dundon; Raphael T Gerraty; Natalie M Saragosa-Harris; Karol P Szymula; Koranis Tanwisuth; J Michael Tyszka; Camilla van Geen; Harang Ju; Arthur W Toga; Joshua I Gold; Dani S Bassett; Catherine A Hartley; Daphna Shohamy; Scott T Grafton; John P O'Doherty
Journal:  Hum Brain Mapp       Date:  2022-07-21       Impact factor: 5.399

4.  Benefiting from trial spacing without the cost of prolonged training: Frequency, not duration, of trials with absent stimuli enhances perceived contingency.

Authors:  Santiago Castiello; Ralph R Miller; James E Witnauer; Doriann M Alcaide; Ethan Fung; Riddhi J Pitliya; Dyedra K C Morrissey; Robin A Murphy
Journal:  J Exp Psychol Gen       Date:  2022-01-06

5.  How do real animals account for the passage of time during associative learning?

Authors:  Vijay Mohan K Namboodiri
Journal:  Behav Neurosci       Date:  2022-04-28       Impact factor: 2.154

6.  A new model of decision processing in instrumental learning tasks.

Authors:  Steven Miletić; Russell J Boag; Anne C Trutti; Niek Stevenson; Birte U Forstmann; Andrew Heathcote
Journal:  Elife       Date:  2021-01-27       Impact factor: 8.140

7.  A Population-Based Model of the Temporal Memory in the Hippocampus.

Authors:  Sorinel A Oprisan; Mona Buhusi; Catalin V Buhusi
Journal:  Front Neurosci       Date:  2018-08-07       Impact factor: 4.677

8.  Improving the reliability of model-based decision-making estimates in the two-stage decision task with reaction-times and drift-diffusion modeling.

Authors:  Nitzan Shahar; Tobias U Hauser; Michael Moutoussis; Rani Moran; Mehdi Keramati; Raymond J Dolan
Journal:  PLoS Comput Biol       Date:  2019-02-13       Impact factor: 4.779

Review 9.  Review: Subjective Time Perception, Dopamine Signaling, and Parkinsonian Slowness.

Authors:  Edison K Miyawaki
Journal:  Front Neurol       Date:  2022-07-08       Impact factor: 4.086

  9 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.