Literature DB >> 29421272

Native language status of the listener modulates the neural integration of speech and iconic gestures in clear and adverse listening conditions.

Linda Drijvers1, Asli Özyürek2.   

Abstract

Native listeners neurally integrate iconic gestures with speech, which can enhance degraded speech comprehension. However, it is unknown how non-native listeners neurally integrate speech and gestures, as they might process visual semantic context differently than natives. We recorded EEG while native and highly-proficient non-native listeners watched videos of an actress uttering an action verb in clear or degraded speech, accompanied by a matching ('to drive'+driving gesture) or mismatching gesture ('to drink'+mixing gesture). Degraded speech elicited an enhanced N400 amplitude compared to clear speech in both groups, revealing an increase in neural resources needed to resolve the spoken input. A larger N400 effect was found in clear speech for non-natives compared to natives, but in degraded speech only for natives. Non-native listeners might thus process gesture more strongly than natives when speech is clear, but need more auditory cues to facilitate access to gestural semantic information when speech is degraded.
Copyright © 2018 The Authors. Published by Elsevier Inc. All rights reserved.

Mesh:

Year:  2018        PMID: 29421272     DOI: 10.1016/j.bandl.2018.01.003

Source DB:  PubMed          Journal:  Brain Lang        ISSN: 0093-934X            Impact factor:   2.381


  4 in total

1.  Entrainment and Modulation of Gesture-Speech Synchrony Under Delayed Auditory Feedback.

Authors:  Wim Pouw; James A Dixon
Journal:  Cogn Sci       Date:  2019-03

2.  Degree of Language Experience Modulates Visual Attention to Visible Speech and Iconic Gestures During Clear and Degraded Speech Comprehension.

Authors:  Linda Drijvers; Julija Vaitonytė; Asli Özyürek
Journal:  Cogn Sci       Date:  2019-10

3.  Beat Gestures for Comprehension and Recall: Differential Effects of Language Learners and Native Listeners.

Authors:  Patrick Louis Rohrer; Elisabeth Delais-Roussarie; Pilar Prieto
Journal:  Front Psychol       Date:  2020-10-19

4.  Rapid invisible frequency tagging reveals nonlinear integration of auditory and visual information.

Authors:  Linda Drijvers; Ole Jensen; Eelke Spaak
Journal:  Hum Brain Mapp       Date:  2020-11-18       Impact factor: 5.399

  4 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.