Literature DB >> 25595613

Speaker's hand gestures modulate speech perception through phase resetting of ongoing neural oscillations.

Emmanuel Biau1, Mireia Torralba1, Lluis Fuentemilla2, Ruth de Diego Balaguer2, Salvador Soto-Faraco3.   

Abstract

Speakers often accompany speech with spontaneous beat gestures in natural spoken communication. These gestures are usually aligned with lexical stress and can modulate the saliency of their affiliate words. Here we addressed the consequences of beat gestures on the neural correlates of speech perception. Previous studies have highlighted the role played by theta oscillations in temporal prediction of speech. We hypothesized that the sight of beat gestures may influence ongoing low-frequency neural oscillations around the onset of the corresponding words. Electroencephalographic (EEG) recordings were acquired while participants watched a continuous, naturally recorded discourse. The phase-locking value (PLV) at word onset was calculated from the EEG from pairs of identical words that had been pronounced with and without a concurrent beat gesture in the discourse. We observed an increase in PLV in the 5-6 Hz theta range as well as a desynchronization in the 8-10 Hz alpha band around the onset of words preceded by a beat gesture. These findings suggest that beats help tune low-frequency oscillatory activity at relevant moments during natural speech perception, providing a new insight of how speech and paralinguistic information are integrated.
Copyright © 2015 Elsevier Ltd. All rights reserved.

Entities:  

Keywords:  Audiovisual speech; Beats; EEG; Low frequency oscillations

Mesh:

Year:  2014        PMID: 25595613     DOI: 10.1016/j.cortex.2014.11.018

Source DB:  PubMed          Journal:  Cortex        ISSN: 0010-9452            Impact factor:   4.027


  11 in total

1.  Listeners consider alternative speaker productions in discourse comprehension and memory: Evidence from beat gesture and pitch accenting.

Authors:  Laura M Morett; Scott H Fraundorf
Journal:  Mem Cognit       Date:  2019-11

2.  Dendritic Cell Factor 1-Knockout Results in Visual Deficit Through the GABA System in Mouse Primary Visual Cortex.

Authors:  Jieyun Shi; Qian Li; Tieqiao Wen
Journal:  Neurosci Bull       Date:  2018-02-12       Impact factor: 5.203

Review 3.  Prediction and constraint in audiovisual speech perception.

Authors:  Jonathan E Peelle; Mitchell S Sommers
Journal:  Cortex       Date:  2015-03-20       Impact factor: 4.027

4.  Eye see what you're saying: Contrastive use of beat gesture and pitch accent affects online interpretation of spoken discourse.

Authors:  Laura M Morett; Scott H Fraundorf; James C McPartland
Journal:  J Exp Psychol Learn Mem Cogn       Date:  2021-02-04       Impact factor: 3.140

5.  Beat gestures influence which speech sounds you hear.

Authors:  Hans Rutger Bosker; David Peeters
Journal:  Proc Biol Sci       Date:  2021-01-27       Impact factor: 5.530

6.  N400 amplitude, latency, and variability reflect temporal integration of beat gesture and pitch accent during language processing.

Authors:  Laura M Morett; Nicole Landi; Julia Irwin; James C McPartland
Journal:  Brain Res       Date:  2020-08-17       Impact factor: 3.610

7.  Editorial: Brain Oscillations in Human Communication.

Authors:  Johanna M Rimmele; Joachim Gross; Sophie Molholm; Anne Keitel
Journal:  Front Hum Neurosci       Date:  2018-02-07       Impact factor: 3.169

Review 8.  Lower Beta: A Central Coordinator of Temporal Prediction in Multimodal Speech.

Authors:  Emmanuel Biau; Sonja A Kotz
Journal:  Front Hum Neurosci       Date:  2018-10-24       Impact factor: 3.169

9.  Synchronization by the hand: the sight of gestures modulates low-frequency activity in brain responses to continuous speech.

Authors:  Emmanuel Biau; Salvador Soto-Faraco
Journal:  Front Hum Neurosci       Date:  2015-09-24       Impact factor: 3.169

10.  The Role of Gamma Oscillations During Integration of Metaphoric Gestures and Abstract Speech.

Authors:  Yifei He; Arne Nagels; Matthias Schlesewsky; Benjamin Straube
Journal:  Front Psychol       Date:  2018-07-30
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.