Literature DB >> 33499783

Beat gestures influence which speech sounds you hear.

Hans Rutger Bosker1,2, David Peeters3.   

Abstract

Beat gestures-spontaneously produced biphasic movements of the hand-are among the most frequently encountered co-speech gestures in human communication. They are closely temporally aligned to the prosodic characteristics of the speech signal, typically occurring on lexically stressed syllables. Despite their prevalence across speakers of the world's languages, how beat gestures impact spoken word recognition is unclear. Can these simple 'flicks of the hand' influence speech perception? Across a range of experiments, we demonstrate that beat gestures influence the explicit and implicit perception of lexical stress (e.g. distinguishing OBject from obJECT), and in turn can influence what vowels listeners hear. Thus, we provide converging evidence for a manual McGurk effect: relatively simple and widely occurring hand movements influence which speech sounds we hear.

Entities:  

Keywords:  audiovisual speech perception; beat gestures; lexical stress; manual McGurk effect; multimodal communication

Mesh:

Year:  2021        PMID: 33499783      PMCID: PMC7893284          DOI: 10.1098/rspb.2020.2419

Source DB:  PubMed          Journal:  Proc Biol Sci        ISSN: 0962-8452            Impact factor:   5.530


  41 in total

1.  Hearing lips and seeing voices.

Authors:  H McGurk; J MacDonald
Journal:  Nature       Date:  1976 Dec 23-30       Impact factor: 49.962

Review 2.  Multimodal Language Processing in Human Communication.

Authors:  Judith Holler; Stephen C Levinson
Journal:  Trends Cogn Sci       Date:  2019-06-21       Impact factor: 20.229

3.  Giving speech a hand: gesture modulates activity in auditory cortex during speech perception.

Authors:  Amy L Hubbard; Stephen M Wilson; Daniel E Callan; Mirella Dapretto
Journal:  Hum Brain Mapp       Date:  2009-03       Impact factor: 5.038

4.  Forty Years After Hearing Lips and Seeing Voices: the McGurk Effect Revisited.

Authors:  Agnès Alsius; Martin Paré; Kevin G Munhall
Journal:  Multisens Res       Date:  2018-01-01       Impact factor: 2.286

5.  Listeners normalize speech for contextual speech rate even without an explicit recognition task.

Authors:  Merel Maslowski; Antje S Meyer; Hans Rutger Bosker
Journal:  J Acoust Soc Am       Date:  2019-07       Impact factor: 1.840

6.  English Listeners Use Suprasegmental Cues to Lexical Stress Early During Spoken-Word Recognition.

Authors:  Alexandra Jesse; Katja Poellmann; Ying-Yee Kong
Journal:  J Speech Lang Hear Res       Date:  2017-01-01       Impact factor: 2.297

Review 7.  Prediction and constraint in audiovisual speech perception.

Authors:  Jonathan E Peelle; Mitchell S Sommers
Journal:  Cortex       Date:  2015-03-20       Impact factor: 4.027

8.  Mechanisms underlying selective neuronal tracking of attended speech at a "cocktail party".

Authors:  Elana M Zion Golumbic; Nai Ding; Stephan Bickel; Peter Lakatos; Catherine A Schevon; Guy M McKhann; Robert R Goodman; Ronald Emerson; Ashesh D Mehta; Jonathan Z Simon; David Poeppel; Charles E Schroeder
Journal:  Neuron       Date:  2013-03-06       Impact factor: 17.173

9.  Visual input enhances selective speech envelope tracking in auditory cortex at a "cocktail party".

Authors:  Elana Zion Golumbic; Gregory B Cogan; Charles E Schroeder; David Poeppel
Journal:  J Neurosci       Date:  2013-01-23       Impact factor: 6.167

10.  Suprasegmental lexical stress cues in visual speech can guide spoken-word recognition.

Authors:  Alexandra Jesse; James M McQueen
Journal:  Q J Exp Psychol (Hove)       Date:  2013-10-18       Impact factor: 2.143

View more
  5 in total

Review 1.  Multilevel rhythms in multimodal communication.

Authors:  Wim Pouw; Shannon Proksch; Linda Drijvers; Marco Gamba; Judith Holler; Christopher Kello; Rebecca S Schaefer; Geraint A Wiggins
Journal:  Philos Trans R Soc Lond B Biol Sci       Date:  2021-08-23       Impact factor: 6.671

2.  What you hear and see specifies the perception of a limb-respiratory-vocal act.

Authors:  Wim Pouw; James A Dixon
Journal:  Proc Biol Sci       Date:  2022-07-20       Impact factor: 5.530

3.  Beat gestures influence which speech sounds you hear.

Authors:  Hans Rutger Bosker; David Peeters
Journal:  Proc Biol Sci       Date:  2021-01-27       Impact factor: 5.530

4.  Evidence For Selective Adaptation and Recalibration in the Perception of Lexical Stress.

Authors:  Hans Rutger Bosker
Journal:  Lang Speech       Date:  2021-07-06       Impact factor: 1.835

5.  The importance of visual control and biomechanics in the regulation of gesture-speech synchrony for an individual deprived of proprioceptive feedback of body position.

Authors:  Wim Pouw; Steven J Harrison; James A Dixon
Journal:  Sci Rep       Date:  2022-08-30       Impact factor: 4.996

  5 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.