Literature DB >> 33336809

Gesture-speech physics in fluent speech and rhythmic upper limb movements.

Wim Pouw1,2,3, Lisette de Jonge-Hoekstra1,4,5, Steven J Harrison1,6, Alexandra Paxton1,7, James A Dixon1,7.   

Abstract

It is commonly understood that hand gesture and speech coordination in humans is culturally and cognitively acquired, rather than having a biological basis. Recently, however, the biomechanical physical coupling of arm movements to speech vocalization has been studied in steady-state vocalization and monosyllabic utterances, where forces produced during gesturing are transferred onto the tensioned body, leading to changes in respiratory-related activity and thereby affecting vocalization F0 and intensity. In the current experiment (n = 37), we extend this previous line of work to show that gesture-speech physics also impacts fluent speech. Compared with nonmovement, participants who are producing fluent self-formulated speech while rhythmically moving their limbs demonstrate heightened F0 and amplitude envelope, and such effects are more pronounced for higher-impulse arm versus lower-impulse wrist movement. We replicate that acoustic peaks arise especially during moments of peak impulse (i.e., the beat) of the movement, namely around deceleration phases of the movement. Finally, higher deceleration rates of higher-mass arm movements were related to higher peaks in acoustics. These results confirm a role for physical impulses of gesture affecting the speech system. We discuss the implications of gesture-speech physics for understanding of the emergence of communicative gesture, both ontogenetically and phylogenetically.
© 2020 The Authors. Annals of the New York Academy of Sciences published by Wiley Periodicals LLC on behalf of New York Academy of Sciences.

Entities:  

Keywords:  biomechanics; entrainment; hand gesture; speech acoustics; speech production

Year:  2020        PMID: 33336809     DOI: 10.1111/nyas.14532

Source DB:  PubMed          Journal:  Ann N Y Acad Sci        ISSN: 0077-8923            Impact factor:   5.691


  2 in total

1.  What you hear and see specifies the perception of a limb-respiratory-vocal act.

Authors:  Wim Pouw; James A Dixon
Journal:  Proc Biol Sci       Date:  2022-07-20       Impact factor: 5.530

2.  The importance of visual control and biomechanics in the regulation of gesture-speech synchrony for an individual deprived of proprioceptive feedback of body position.

Authors:  Wim Pouw; Steven J Harrison; James A Dixon
Journal:  Sci Rep       Date:  2022-08-30       Impact factor: 4.996

  2 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.