Literature DB >> 31368760

Gesture-speech physics: The biomechanical basis for the emergence of gesture-speech synchrony.

Wim Pouw1, Steven J Harrison1, James A Dixon1.   

Abstract

The phenomenon of gesture-speech synchrony involves tight coupling of prosodic contrasts in gesture movement (e.g., peak velocity) and speech (e.g., peaks in fundamental frequency; F0). Gesture-speech synchrony has been understood as completely governed by sophisticated neural-cognitive mechanisms. However, gesture-speech synchrony may have its original basis in the resonating forces that travel through the body. In the current preregistered study, movements with high physical impact affected phonation in line with gesture-speech synchrony as observed in natural contexts. Rhythmic beating of the arms entrained phonation acoustics (F0 and the amplitude envelope). Such effects were absent for a condition with low-impetus movements (wrist movements) and a condition without movement. Further, movement-phonation synchrony was more pronounced when participants were standing as opposed to sitting, indicating a mediating role for postural stability. We conclude that gesture-speech synchrony has a biomechanical basis, which will have implications for our cognitive, ontogenetic, and phylogenetic understanding of multimodal language. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

Entities:  

Mesh:

Year:  2019        PMID: 31368760     DOI: 10.1037/xge0000646

Source DB:  PubMed          Journal:  J Exp Psychol Gen        ISSN: 0022-1015


  10 in total

1.  Reply to Ravignani and Kotz: Physical impulses from upper-limb movements impact the respiratory-vocal system.

Authors:  Wim Pouw; Alexandra Paxton; Steven J Harrison; James A Dixon
Journal:  Proc Natl Acad Sci U S A       Date:  2020-09-22       Impact factor: 11.205

2.  Reciprocal Influence of Mobility and Speech-Language: Advancing Physical Therapy and Speech Therapy Cotreatment and Collaboration for Adults With Neurological Conditions.

Authors:  Sarah M Schwab; Sarah Dugan; Michael A Riley
Journal:  Phys Ther       Date:  2021-11-01

3.  Modulation transfer functions for audiovisual speech.

Authors:  Nicolai F Pedersen; Torsten Dau; Lars Kai Hansen; Jens Hjortkjær
Journal:  PLoS Comput Biol       Date:  2022-07-19       Impact factor: 4.779

4.  What you hear and see specifies the perception of a limb-respiratory-vocal act.

Authors:  Wim Pouw; James A Dixon
Journal:  Proc Biol Sci       Date:  2022-07-20       Impact factor: 5.530

5.  Beat gestures influence which speech sounds you hear.

Authors:  Hans Rutger Bosker; David Peeters
Journal:  Proc Biol Sci       Date:  2021-01-27       Impact factor: 5.530

6.  A multi-scale investigation of the human communication system's response to visual disruption.

Authors:  James P Trujillo; Stephen C Levinson; Judith Holler
Journal:  R Soc Open Sci       Date:  2022-04-13       Impact factor: 2.963

7.  The importance of visual control and biomechanics in the regulation of gesture-speech synchrony for an individual deprived of proprioceptive feedback of body position.

Authors:  Wim Pouw; Steven J Harrison; James A Dixon
Journal:  Sci Rep       Date:  2022-08-30       Impact factor: 4.996

8.  Acoustic information about upper limb movement in voicing.

Authors:  Wim Pouw; Alexandra Paxton; Steven J Harrison; James A Dixon
Journal:  Proc Natl Acad Sci U S A       Date:  2020-05-11       Impact factor: 11.205

9.  The quantification of gesture-speech synchrony: A tutorial and validation of multimodal data acquisition using device-based and video-based motion tracking.

Authors:  Wim Pouw; James P Trujillo; James A Dixon
Journal:  Behav Res Methods       Date:  2020-04

10.  Beat Gestures for Comprehension and Recall: Differential Effects of Language Learners and Native Listeners.

Authors:  Patrick Louis Rohrer; Elisabeth Delais-Roussarie; Pilar Prieto
Journal:  Front Psychol       Date:  2020-10-19
  10 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.