Literature DB >> 35340847

A step-by-step tutorial on active inference and its application to empirical data.

Ryan Smith1, Karl J Friston2, Christopher J Whyte3.   

Abstract

The active inference framework, and in particular its recent formulation as a partially observable Markov decision process (POMDP), has gained increasing popularity in recent years as a useful approach for modeling neurocognitive processes. This framework is highly general and flexible in its ability to be customized to model any cognitive process, as well as simulate predicted neuronal responses based on its accompanying neural process theory. It also affords both simulation experiments for proof of principle and behavioral modeling for empirical studies. However, there are limited resources that explain how to build and run these models in practice, which limits their widespread use. Most introductions assume a technical background in programming, mathematics, and machine learning. In this paper we offer a step-by-step tutorial on how to build POMDPs, run simulations using standard MATLAB routines, and fit these models to empirical data. We assume a minimal background in programming and mathematics, thoroughly explain all equations, and provide exemplar scripts that can be customized for both theoretical and empirical studies. Our goal is to provide the reader with the requisite background knowledge and practical tools to apply active inference to their own research. We also provide optional technical sections and multiple appendices, which offer the interested reader additional technical details. This tutorial should provide the reader with all the tools necessary to use these models and to follow emerging advances in active inference research.

Entities:  

Keywords:  Active inference; Bayesian inference; Computational neuroscience; Decision-making; Learning; Machine learning

Year:  2022        PMID: 35340847      PMCID: PMC8956124          DOI: 10.1016/j.jmp.2021.102632

Source DB:  PubMed          Journal:  J Math Psychol        ISSN: 0022-2496            Impact factor:   1.387


  63 in total

1.  Neural signature of the conscious processing of auditory regularities.

Authors:  Tristan A Bekinschtein; Stanislas Dehaene; Benjamin Rohaut; François Tadel; Laurent Cohen; Lionel Naccache
Journal:  Proc Natl Acad Sci U S A       Date:  2009-01-21       Impact factor: 11.205

2.  Active Inference: Demystified and Compared.

Authors:  Noor Sajid; Philip J Ball; Thomas Parr; Karl J Friston
Journal:  Neural Comput       Date:  2021-01-05       Impact factor: 2.026

3.  Active Inference: A Process Theory.

Authors:  Karl Friston; Thomas FitzGerald; Francesco Rigoli; Philipp Schwartenbeck; Giovanni Pezzulo
Journal:  Neural Comput       Date:  2016-11-21       Impact factor: 2.026

Review 4.  Whatever next? Predictive brains, situated agents, and the future of cognitive science.

Authors:  Andy Clark
Journal:  Behav Brain Sci       Date:  2013-05-10       Impact factor: 12.579

5.  Humans use directed and random exploration to solve the explore-exploit dilemma.

Authors:  Robert C Wilson; Andra Geana; John M White; Elliot A Ludvig; Jonathan D Cohen
Journal:  J Exp Psychol Gen       Date:  2014-10-27

6.  Imprecise action selection in substance use disorder: Evidence for active learning impairments when solving the explore-exploit dilemma.

Authors:  Ryan Smith; Philipp Schwartenbeck; Jennifer L Stewart; Rayus Kuplicki; Hamed Ekhtiari; Martin P Paulus
Journal:  Drug Alcohol Depend       Date:  2020-08-06       Impact factor: 4.492

7.  The Discrete and Continuous Brain: From Decisions to Movement-And Back Again.

Authors:  Thomas Parr; Karl J Friston
Journal:  Neural Comput       Date:  2018-06-12       Impact factor: 2.026

8.  Bayesian model selection for group studies.

Authors:  Klaas Enno Stephan; Will D Penny; Jean Daunizeau; Rosalyn J Moran; Karl J Friston
Journal:  Neuroimage       Date:  2009-03-20       Impact factor: 6.556

9.  An Active Inference Approach to Dissecting Reasons for Nonadherence to Antidepressants.

Authors:  Ryan Smith; Sahib S Khalsa; Martin P Paulus
Journal:  Biol Psychiatry Cogn Neurosci Neuroimaging       Date:  2019-12-05
View more
  8 in total

1.  Active inference unifies intentional and conflict-resolution imperatives of motor control.

Authors:  Antonella Maselli; Pablo Lanillos; Giovanni Pezzulo
Journal:  PLoS Comput Biol       Date:  2022-06-17       Impact factor: 4.779

2.  Active inference and the two-step task.

Authors:  Sam Gijsen; Miro Grundei; Felix Blankenburg
Journal:  Sci Rep       Date:  2022-10-21       Impact factor: 4.996

3.  A Bayesian Surprise Approach in Designing Cognitive Radar for Autonomous Driving.

Authors:  Yeganeh Zamiri-Jafarian; Konstantinos N Plataniotis
Journal:  Entropy (Basel)       Date:  2022-05-10       Impact factor: 2.738

4.  Organizational Neuroscience of Industrial Adaptive Behavior.

Authors:  Stephen Fox; Adrian Kotelba
Journal:  Behav Sci (Basel)       Date:  2022-05-03

5.  From Generative Models to Generative Passages: A Computational Approach to (Neuro) Phenomenology.

Authors:  Maxwell J D Ramstead; Anil K Seth; Casper Hesp; Lars Sandved-Smith; Jonas Mago; Michael Lifshitz; Giuseppe Pagnoni; Ryan Smith; Guillaume Dumas; Antoine Lutz; Karl Friston; Axel Constant
Journal:  Rev Philos Psychol       Date:  2022-03-18

6.  Embodied Object Representation Learning and Recognition.

Authors:  Toon Van de Maele; Tim Verbelen; Ozan Çatal; Bart Dhoedt
Journal:  Front Neurorobot       Date:  2022-04-14       Impact factor: 3.493

7.  Intersubjectivity as an antidote to stress: Using dyadic active inference model of intersubjectivity to predict the efficacy of parenting interventions in reducing stress-through the lens of dependent origination in Buddhist Madhyamaka philosophy.

Authors:  S Shaun Ho; Yoshio Nakamura; Meroona Gopang; James E Swain
Journal:  Front Psychol       Date:  2022-07-29

8.  Learned uncertainty: The free energy principle in anxiety.

Authors:  H T McGovern; Alexander De Foe; Hannah Biddell; Pantelis Leptourgos; Philip Corlett; Kavindu Bandara; Brendan T Hutchinson
Journal:  Front Psychol       Date:  2022-09-06
  8 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.