Literature DB >> 26450589

The relative roles of visuospatial and linguistic working memory systems in generating inferences during visual narrative comprehension.

Joseph P Magliano1, Adam M Larson2, Karyn Higgs3, Lester C Loschky4.   

Abstract

This study investigated the relative roles of visuospatial versus linguistic working memory (WM) systems in the online generation of bridging inferences while viewers comprehend visual narratives. We contrasted these relative roles in the visuospatial primacy hypothesis versus the shared (visuospatial & linguistic) systems hypothesis, and tested them in 3 experiments. Participants viewed picture stories containing multiple target episodes consisting of a beginning state, a bridging event, and an end state, respectively, and the presence of the bridging event was manipulated. When absent, viewers had to infer the bridging-event action to comprehend the end-state image. A pilot study showed that after viewing the end-state image, participants' think-aloud protocols contained more inferred actions when the bridging event was absent than when it was present. Likewise, Experiment 1 found longer viewing times for the end-state image when the bridging-event image was absent, consistent with viewing times revealing online inference generation processes. Experiment 2 showed that both linguistic and visuospatial WM loads attenuated the inference viewing time effect, consistent with the shared systems hypothesis. Importantly, however, Experiment 3 found that articulatory suppression did not attenuate the inference viewing time effect, indicating that (sub)vocalization did not support online inference generation during visual narrative comprehension. Thus, the results support a shared-systems hypothesis in which both visuospatial and linguistic WM systems support inference generation in visual narratives, with the linguistic WM system operating at a deeper level than (sub)vocalization.

Entities:  

Keywords:  Language comprehension; Working memory

Mesh:

Year:  2016        PMID: 26450589     DOI: 10.3758/s13421-015-0558-7

Source DB:  PubMed          Journal:  Mem Cognit        ISSN: 0090-502X


  43 in total

1.  What the eyes say about speaking.

Authors:  Z M Griffin; K Bock
Journal:  Psychol Sci       Date:  2000-07

2.  Perceptual components of situation models.

Authors:  R Fincher-Kiefer
Journal:  Mem Cognit       Date:  2001-03

3.  Early activation of object names in visual search.

Authors:  Antje S Meyer; Eva Belke; Anna L Telling; Glyn W Humphreys
Journal:  Psychon Bull Rev       Date:  2007-08

4.  Embodied relations are encoded in language.

Authors:  Max M Louwerse
Journal:  Psychon Bull Rev       Date:  2008-08

Review 5.  Memory-based language processing: psycholinguistic research in the 1990s.

Authors:  G McKoon; R Ratcliff
Journal:  Annu Rev Psychol       Date:  1998       Impact factor: 24.137

6.  (Pea)nuts and bolts of visual narrative: structure and meaning in sequential image comprehension.

Authors:  Neil Cohn; Martin Paczynski; Ray Jackendoff; Phillip J Holcomb; Gina R Kuperberg
Journal:  Cogn Psychol       Date:  2012-03-02       Impact factor: 3.468

7.  Perceiving, remembering, and communicating structure in events.

Authors:  J M Zacks; B Tversky; G Iyer
Journal:  J Exp Psychol Gen       Date:  2001-03

8.  Visual narrative structure.

Authors:  Neil Cohn
Journal:  Cogn Sci       Date:  2012-11-19

9.  Verbal overshadowing of visual memories: some things are better left unsaid.

Authors:  J W Schooler; T Y Engstler-Schooler
Journal:  Cogn Psychol       Date:  1990-01       Impact factor: 3.468

10.  Segmentation in reading and film comprehension.

Authors:  Jeffrey M Zacks; Nicole K Speer; Jeremy R Reynolds
Journal:  J Exp Psychol Gen       Date:  2009-05
View more
  12 in total

1.  Reading Pictures for Story Comprehension Requires Mental Imagery Skills.

Authors:  Inouk E Boerma; Suzanne E Mol; Jelle Jolles
Journal:  Front Psychol       Date:  2016-10-24

2.  What is your neural function, visual narrative conjunction? Grammar, meaning, and fluency in sequential image processing.

Authors:  Neil Cohn; Marta Kutas
Journal:  Cogn Res Princ Implic       Date:  2017-05-24

3.  Cross-codal integration of bridging-event information in narrative understanding.

Authors:  Markus Huff; Dina Rosenfelder; Maria Oberbeck; Martin Merkt; Frank Papenmeier; Tino G K Meitz
Journal:  Mem Cognit       Date:  2020-08

4.  Understanding Moment-to-Moment Processing of Visual Narratives.

Authors:  John P Hutson; Joseph P Magliano; Lester C Loschky
Journal:  Cogn Sci       Date:  2018-11-16

5.  Filling the gap despite full attention: the role of fast backward inferences for event completion.

Authors:  Frank Papenmeier; Alisa Brockhoff; Markus Huff
Journal:  Cogn Res Princ Implic       Date:  2019-01-28

Review 6.  Picture This: A Review of Research Relating to Narrative Processing by Moving Image Versus Language.

Authors:  Elspeth Jajdelska; Miranda Anderson; Christopher Butler; Nigel Fabb; Elizabeth Finnigan; Ian Garwood; Stephen Kelly; Wendy Kirk; Karin Kukkonen; Sinead Mullally; Stephan Schwan
Journal:  Front Psychol       Date:  2019-06-26

Review 7.  Visual narrative comprehension: Universal or not?

Authors:  Neil Cohn
Journal:  Psychon Bull Rev       Date:  2020-04

8.  A starring role for inference in the neurocognition of visual narratives.

Authors:  Neil Cohn
Journal:  Cogn Res Princ Implic       Date:  2021-02-15

9.  What is the role of the film viewer? The effects of narrative comprehension and viewing task on gaze control in film.

Authors:  John P Hutson; Tim J Smith; Joseph P Magliano; Lester C Loschky
Journal:  Cogn Res Princ Implic       Date:  2017-11-22

10.  The Scene Perception & Event Comprehension Theory (SPECT) Applied to Visual Narratives.

Authors:  Lester C Loschky; Adam M Larson; Tim J Smith; Joseph P Magliano
Journal:  Top Cogn Sci       Date:  2019-09-04
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.