Literature DB >> 31551597

Learning task-state representations.

Yael Niv1.   

Abstract

Arguably, the most difficult part of learning is deciding what to learn about. Should I associate the positive outcome of safely completing a street-crossing with the situation 'the car approaching the crosswalk was red' or with 'the approaching car was slowing down'? In this Perspective, we summarize our recent research into the computational and neural underpinnings of 'representation learning'-how humans (and other animals) construct task representations that allow efficient learning and decision-making. We first discuss the problem of learning what to ignore when confronted with too much information, so that experience can properly generalize across situations. We then turn to the problem of augmenting perceptual information with inferred latent causes that embody unobservable task-relevant information, such as contextual knowledge. Finally, we discuss recent findings regarding the neural substrates of task representations that suggest the orbitofrontal cortex represents 'task states', deploying them for decision-making and learning elsewhere in the brain.

Entities:  

Mesh:

Year:  2019        PMID: 31551597      PMCID: PMC7241310          DOI: 10.1038/s41593-019-0470-8

Source DB:  PubMed          Journal:  Nat Neurosci        ISSN: 1097-6256            Impact factor:   24.884


  82 in total

1.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control.

Authors:  Nathaniel D Daw; Yael Niv; Peter Dayan
Journal:  Nat Neurosci       Date:  2005-11-06       Impact factor: 24.884

Review 2.  Context, learning, and extinction.

Authors:  Samuel J Gershman; David M Blei; Yael Niv
Journal:  Psychol Rev       Date:  2010-01       Impact factor: 8.934

Review 3.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning.

Authors:  P R Montague; P Dayan; T J Sejnowski
Journal:  J Neurosci       Date:  1996-03-01       Impact factor: 6.167

4.  Reinforcement learning in multidimensional environments relies on attention mechanisms.

Authors:  Yael Niv; Reka Daniel; Andra Geana; Samuel J Gershman; Yuan Chang Leong; Angela Radulescu; Robert C Wilson
Journal:  J Neurosci       Date:  2015-05-27       Impact factor: 6.167

5.  Adaptive integration of habits into depth-limited planning defines a habitual-goal-directed spectrum.

Authors:  Mehdi Keramati; Peter Smittenaar; Raymond J Dolan; Peter Dayan
Journal:  Proc Natl Acad Sci U S A       Date:  2016-10-24       Impact factor: 11.205

6.  Reinforcement learning with Marr.

Authors:  Yael Niv; Angela Langdon
Journal:  Curr Opin Behav Sci       Date:  2016-10

7.  Dynamic Interaction between Reinforcement Learning and Attention in Multidimensional Environments.

Authors:  Yuan Chang Leong; Angela Radulescu; Reka Daniel; Vivian DeWoskin; Yael Niv
Journal:  Neuron       Date:  2017-01-18       Impact factor: 17.173

8.  Orbitofrontal cortex as a cognitive map of task space.

Authors:  G Schoenbaum; Yael Niv; Robert C Wilson; Yuji K Takahashi
Journal:  Neuron       Date:  2014-01-22       Impact factor: 17.173

9.  Human Orbitofrontal Cortex Represents a Cognitive Map of State Space.

Authors:  Nicolas W Schuck; Ming Bo Cai; Robert C Wilson; Yael Niv
Journal:  Neuron       Date:  2016-09-21       Impact factor: 17.173

10.  Goal-Directed Decision Making with Spiking Neurons.

Authors:  Johannes Friedrich; Máté Lengyel
Journal:  J Neurosci       Date:  2016-02-03       Impact factor: 6.167

View more
  57 in total

1.  Neural representation of abstract task structure during generalization.

Authors:  Avinash R Vaidya; Henry M Jones; Johanny Castillo; David Badre
Journal:  Elife       Date:  2021-03-17       Impact factor: 8.140

Review 2.  The influence of subcortical shortcuts on disordered sensory and cognitive processing.

Authors:  Jessica McFadyen; Raymond J Dolan; Marta I Garrido
Journal:  Nat Rev Neurosci       Date:  2020-04-08       Impact factor: 34.870

3.  Orbitofrontal State Representations Are Related to Choice Adaptations and Reward Predictions.

Authors:  Thomas A Stalnaker; Nishika Raheja; Geoffrey Schoenbaum
Journal:  J Neurosci       Date:  2021-01-14       Impact factor: 6.167

4.  Preparation for upcoming attentional states in the hippocampus and medial prefrontal cortex.

Authors:  Eren Günseli; Mariam Aly
Journal:  Elife       Date:  2020-04-07       Impact factor: 8.140

5.  Cognitive maps of social features enable flexible inference in social networks.

Authors:  Jae-Young Son; Apoorva Bhandari; Oriel FeldmanHall
Journal:  Proc Natl Acad Sci U S A       Date:  2021-09-28       Impact factor: 11.205

6.  The Role of the Rodent Lateral Orbitofrontal Cortex in Simple Pavlovian Cue-Outcome Learning Depends on Training Experience.

Authors:  Marios C Panayi; Simon Killcross
Journal:  Cereb Cortex Commun       Date:  2021-02-09

7.  Revaluing the Role of vmPFC in the Acquisition of Pavlovian Threat Conditioning in Humans.

Authors:  Simone Battaglia; Sara Garofalo; Giuseppe di Pellegrino; Francesca Starita
Journal:  J Neurosci       Date:  2020-10-05       Impact factor: 6.167

8.  Value signals guide abstraction during learning.

Authors:  Aurelio Cortese; Asuka Yamamoto; Maryam Hashemzadeh; Pradyumna Sepulveda; Mitsuo Kawato; Benedetto De Martino
Journal:  Elife       Date:  2021-07-13       Impact factor: 8.140

Review 9.  What are grid-like responses doing in the orbitofrontal cortex?

Authors:  Clara U Raithel; Jay A Gottfried
Journal:  Behav Neurosci       Date:  2021-03-18       Impact factor: 1.912

10.  Continuous decisions.

Authors:  Seng Bum Michael Yoo; Benjamin Yost Hayden; John M Pearson
Journal:  Philos Trans R Soc Lond B Biol Sci       Date:  2021-01-11       Impact factor: 6.237

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.