Literature DB >> 28358657

The Cost of Structure Learning.

Anne G E Collins1.   

Abstract

Human learning is highly efficient and flexible. A key contributor to this learning flexibility is our ability to generalize new information across contexts that we know require the same behavior and to transfer rules to new contexts we encounter. To do this, we structure the information we learn and represent it hierarchically as abstract, context-dependent rules that constrain lower-level stimulus-action-outcome contingencies. Previous research showed that humans create such structure even when it is not needed, presumably because it usually affords long-term generalization benefits. However, computational models predict that creating structure is costly, with slower learning and slower RTs. We tested this prediction in a new behavioral experiment. Participants learned to select correct actions for four visual patterns, in a setting that either afforded (but did not promote) structure learning or enforced nonhierarchical learning, while controlling for the difficulty of the learning problem. Results replicated our previous finding that healthy young adults create structure even when unneeded and that this structure affords later generalization. Furthermore, they supported our prediction that structure learning incurred a major learning cost and that this cost was specifically tied to the effort in selecting abstract rules, leading to more errors when applying those rules. These findings confirm our theory that humans pay a high short-term cost in learning structure to enable longer-term benefits in learning flexibility.

Entities:  

Mesh:

Year:  2017        PMID: 28358657     DOI: 10.1162/jocn_a_01128

Source DB:  PubMed          Journal:  J Cogn Neurosci        ISSN: 0898-929X            Impact factor:   3.225


  8 in total

1.  Computational evidence for hierarchically structured reinforcement learning in humans.

Authors:  Maria K Eckstein; Anne G E Collins
Journal:  Proc Natl Acad Sci U S A       Date:  2020-11-24       Impact factor: 11.205

2.  Cognitive maps of social features enable flexible inference in social networks.

Authors:  Jae-Young Son; Apoorva Bhandari; Oriel FeldmanHall
Journal:  Proc Natl Acad Sci U S A       Date:  2021-09-28       Impact factor: 11.205

3.  Learning Structures: Predictive Representations, Replay, and Generalization.

Authors:  Ida Momennejad
Journal:  Curr Opin Behav Sci       Date:  2020-05-05

4.  Temporal and state abstractions for efficient learning, transfer, and composition in humans.

Authors:  Liyu Xia; Anne G E Collins
Journal:  Psychol Rev       Date:  2021-05-20       Impact factor: 8.247

5.  Deterministic response strategies in a trial-and-error learning task.

Authors:  Holger Mohr; Katharina Zwosta; Dimitrije Markovic; Sebastian Bitzer; Uta Wolfensteller; Hannes Ruge
Journal:  PLoS Comput Biol       Date:  2018-11-29       Impact factor: 4.475

6.  Comparing continual task learning in minds and machines.

Authors:  Timo Flesch; Jan Balaguer; Ronald Dekker; Hamed Nili; Christopher Summerfield
Journal:  Proc Natl Acad Sci U S A       Date:  2018-10-15       Impact factor: 11.205

7.  Spontaneous Task Structure Formation Results in a Cost to Incidental Memory of Task Stimuli.

Authors:  Christina Bejjani; Tobias Egner
Journal:  Front Psychol       Date:  2019-12-17

8.  Generalizing to generalize: Humans flexibly switch between compositional and conjunctive structures during reinforcement learning.

Authors:  Nicholas T Franklin; Michael J Frank
Journal:  PLoS Comput Biol       Date:  2020-04-13       Impact factor: 4.475

  8 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.