Literature DB >> 33587244

A starring role for inference in the neurocognition of visual narratives.

Neil Cohn1.   

Abstract

Research in verbal and visual narratives has often emphasized backward-looking inferences, where absent information is subsequently inferred. However, comics use conventions like star-shaped "action stars" where a reader knows events are undepicted at that moment, rather than omitted entirely. We contrasted the event-related brain potentials (ERPs) to visual narratives depicting an explicit event, an action star, or a "noise" panel of scrambled lines. Both action stars and noise panels evoked large N400s compared to explicit-events (300-500 ms), but action stars and noise panels then differed in their later effects (500-900 ms). Action stars elicited sustained negativities and P600s, which could indicate further interpretive processes and integration of meaning into a mental model, while noise panels evoked late frontal positivities possibly indexing that they were improbable narrative units. Nevertheless, panels following action stars and noise panels both evoked late sustained negativities, implying further inferential processing. Inference in visual narratives thus uses cascading mechanisms resembling those in language processing that differ based on the inferential techniques.

Entities:  

Keywords:  Comics; Discourse; Inference; Visual language; Visual narrative

Year:  2021        PMID: 33587244      PMCID: PMC7884514          DOI: 10.1186/s41235-021-00270-9

Source DB:  PubMed          Journal:  Cogn Res Princ Implic        ISSN: 2365-7464


  49 in total

1.  An electrophysiological investigation of semantic priming with pictures of real objects.

Authors:  W B McPherson; P J Holcomb
Journal:  Psychophysiology       Date:  1999-01       Impact factor: 4.016

2.  Comparison of the N300 and N400 ERPs to picture stimuli in congruent and incongruent contexts.

Authors:  Jeff P Hamm; Blake W Johnson; Ian J Kirk
Journal:  Clin Neurophysiol       Date:  2002-08       Impact factor: 3.708

3.  Syntactically based sentence processing classes: evidence from event-related brain potentials.

Authors:  H Neville; J L Nicol; A Barss; K I Forster; M F Garrett
Journal:  J Cogn Neurosci       Date:  1991       Impact factor: 3.225

4.  Reading senseless sentences: brain potentials reflect semantic incongruity.

Authors:  M Kutas; S A Hillyard
Journal:  Science       Date:  1980-01-11       Impact factor: 47.728

5.  The grammar of visual narrative: Neural evidence for constituent structure in sequential image comprehension.

Authors:  Neil Cohn; Ray Jackendoff; Phillip J Holcomb; Gina R Kuperberg
Journal:  Neuropsychologia       Date:  2014-09-18       Impact factor: 3.139

6.  Action starring narratives and events: Structure and inference in visual narrative comprehension.

Authors:  Neil Cohn; Eva Wittenberg
Journal:  J Cogn Psychol (Hove)       Date:  2015-07-14

7.  Differential electrophysiological signatures of semantic and syntactic scene processing.

Authors:  Melissa L-H Võ; Jeremy M Wolfe
Journal:  Psychol Sci       Date:  2013-07-10

8.  ERPLAB: an open-source toolbox for the analysis of event-related potentials.

Authors:  Javier Lopez-Calderon; Steven J Luck
Journal:  Front Hum Neurosci       Date:  2014-04-14       Impact factor: 3.169

9.  What is your neural function, visual narrative conjunction? Grammar, meaning, and fluency in sequential image processing.

Authors:  Neil Cohn; Marta Kutas
Journal:  Cogn Res Princ Implic       Date:  2017-05-24

10.  PsychoPy2: Experiments in behavior made easy.

Authors:  Jonathan Peirce; Jeremy R Gray; Sol Simpson; Michael MacAskill; Richard Höchenberger; Hiroyuki Sogo; Erik Kastman; Jonas Kristoffer Lindeløv
Journal:  Behav Res Methods       Date:  2019-02
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.