Literature DB >> 32416227

Neural dynamics of sentiment processing during naturalistic sentence reading.

Christian Pfeiffer1, Nora Hollenstein2, Ce Zhang2, Nicolas Langer3.   

Abstract

When we read, our eyes move through the text in a series of fixations and high-velocity saccades to extract visual information. This process allows the brain to obtain meaning, e.g., about sentiment, or the emotional valence, expressed in the written text. How exactly the brain extracts the sentiment of single words during naturalistic reading is largely unknown. This is due to the challenges of naturalistic imaging, which has previously led researchers to employ highly controlled, timed word-by-word presentations of custom reading materials that lack ecological validity. Here, we aimed to assess the electrical neural correlates of word sentiment processing during naturalistic reading of English sentences. We used a publicly available dataset of simultaneous electroencephalography (EEG), eye-tracking recordings, and word-level semantic annotations from 7129 words in 400 sentences (Zurich Cognitive Language Processing Corpus; Hollenstein et al., 2018). We computed fixation-related potentials (FRPs), which are evoked electrical responses time-locked to the onset of fixations. A general linear mixed model analysis of FRPs cleaned from visual- and motor-evoked activity showed a topographical difference between the positive and negative sentiment condition in the 224-304 ​ms interval after fixation onset in left-central and right-posterior electrode clusters. An additional analysis that included word-, phrase-, and sentence-level sentiment predictors showed the same FRP differences for the word-level sentiment, but no additional FRP differences for phrase- and sentence-level sentiment. Furthermore, decoding analysis that classified word sentiment (positive or negative) from sentiment-matched 40-trial average FRPs showed a 0.60 average accuracy (95% confidence interval: [0.58, 0.61]). Control analyses ruled out that these results were based on differences in eye movements or linguistic features other than word sentiment. Our results extend previous research by showing that the emotional valence of lexico-semantic stimuli evoke a fast electrical neural response upon word fixation during naturalistic reading. These results provide an important step to identify the neural processes of lexico-semantic processing in ecologically valid conditions and can serve to improve computer algorithms for natural language processing.
Copyright © 2020 The Authors. Published by Elsevier Inc. All rights reserved.

Entities:  

Mesh:

Year:  2020        PMID: 32416227     DOI: 10.1016/j.neuroimage.2020.116934

Source DB:  PubMed          Journal:  Neuroimage        ISSN: 1053-8119            Impact factor:   6.556


  3 in total

1.  Toward Measuring Target Perception: First-Order and Second-Order Deep Network Pipeline for Classification of Fixation-Related Potentials.

Authors:  Hong Zeng; Junjie Shen; Wenming Zheng; Aiguo Song; Jia Liu
Journal:  J Healthc Eng       Date:  2020-11-19       Impact factor: 2.682

Review 2.  Naturalistic Stimuli in Affective Neuroimaging: A Review.

Authors:  Heini Saarimäki
Journal:  Front Hum Neurosci       Date:  2021-06-17       Impact factor: 3.169

3.  Decoding EEG Brain Activity for Multi-Modal Natural Language Processing.

Authors:  Nora Hollenstein; Cedric Renggli; Benjamin Glaus; Maria Barrett; Marius Troendle; Nicolas Langer; Ce Zhang
Journal:  Front Hum Neurosci       Date:  2021-07-13       Impact factor: 3.169

  3 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.