Literature DB >> 28887798

Processing language in face-to-face conversation: Questions with gestures get faster responses.

Judith Holler1,2, Kobin H Kendrick3,4, Stephen C Levinson3,5.   

Abstract

The home of human language use is face-to-face interaction, a context in which communicative exchanges are characterised not only by bodily signals accompanying what is being said but also by a pattern of alternating turns at talk. This transition between turns is astonishingly fast-typically a mere 200-ms elapse between a current and a next speaker's contribution-meaning that comprehending, producing, and coordinating conversational contributions in time is a significant challenge. This begs the question of whether the additional information carried by bodily signals facilitates or hinders language processing in this time-pressured environment. We present analyses of multimodal conversations revealing that bodily signals appear to profoundly influence language processing in interaction: Questions accompanied by gestures lead to shorter turn transition times-that is, to faster responses-than questions without gestures, and responses come earlier when gestures end before compared to after the question turn has ended. These findings hold even after taking into account prosodic patterns and other visual signals, such as gaze. The empirical findings presented here provide a first glimpse of the role of the body in the psycholinguistic processes underpinning human communication.

Entities:  

Keywords:  Gesture; Language processing; Multimodal communication; Turn-taking

Mesh:

Year:  2018        PMID: 28887798     DOI: 10.3758/s13423-017-1363-z

Source DB:  PubMed          Journal:  Psychon Bull Rev        ISSN: 1069-9384


  18 in total

1.  Neural correlates of bimodal speech and gesture comprehension.

Authors:  Spencer D Kelly; Corinne Kravitz; Michael Hopkins
Journal:  Brain Lang       Date:  2004-04       Impact factor: 2.381

2.  Feeling addressed! The role of body orientation and co-speech gesture in social communication.

Authors:  Arne Nagels; Tilo Kircher; Miriam Steines; Benjamin Straube
Journal:  Hum Brain Mapp       Date:  2015-01-30       Impact factor: 5.038

3.  Universals and cultural variation in turn-taking in conversation.

Authors:  Tanya Stivers; N J Enfield; Penelope Brown; Christina Englert; Makoto Hayashi; Trine Heinemann; Gertie Hoymann; Federico Rossano; Jan Peter de Ruiter; Kyung-Eun Yoon; Stephen C Levinson
Journal:  Proc Natl Acad Sci U S A       Date:  2009-06-24       Impact factor: 11.205

4.  Some functions of gaze-direction in social interaction.

Authors:  A Kendon
Journal:  Acta Psychol (Amst)       Date:  1967

5.  Two sides of the same coin: speech and gesture mutually interact to enhance comprehension.

Authors:  Spencer D Kelly; Asli Ozyürek; Eric Maris
Journal:  Psychol Sci       Date:  2009-12-22

6.  Iconic Gestures Facilitate Discourse Comprehension in Individuals With Superior Immediate Memory for Body Configurations.

Authors:  Ying Choon Wu; Seana Coulson
Journal:  Psychol Sci       Date:  2015-09-17

7.  Unaddressed participants' gaze in multi-person interaction: optimizing recipiency.

Authors:  Judith Holler; Kobin H Kendrick
Journal:  Front Psychol       Date:  2015-02-09

8.  Timing in turn-taking and its implications for processing models of language.

Authors:  Stephen C Levinson; Francisco Torreira
Journal:  Front Psychol       Date:  2015-06-12

9.  The effects of processing and sequence organization on the timing of turn taking: a corpus study.

Authors:  Seán G Roberts; Francisco Torreira; Stephen C Levinson
Journal:  Front Psychol       Date:  2015-05-13

10.  Prediction of turn-ends based on anticipation of upcoming words.

Authors:  Lilla Magyari; J P de Ruiter
Journal:  Front Psychol       Date:  2012-10-01
View more
  6 in total

Review 1.  Multilevel rhythms in multimodal communication.

Authors:  Wim Pouw; Shannon Proksch; Linda Drijvers; Marco Gamba; Judith Holler; Christopher Kello; Rebecca S Schaefer; Geraint A Wiggins
Journal:  Philos Trans R Soc Lond B Biol Sci       Date:  2021-08-23       Impact factor: 6.671

2.  Understanding Design Features of Music and Language: The Choric/Dialogic Distinction.

Authors:  Felix Haiduk; W Tecumseh Fitch
Journal:  Front Psychol       Date:  2022-04-22

3.  Eye blinks are perceived as communicative signals in human face-to-face interaction.

Authors:  Paul Hömke; Judith Holler; Stephen C Levinson
Journal:  PLoS One       Date:  2018-12-12       Impact factor: 3.240

Review 4.  Visual bodily signals as core devices for coordinating minds in interaction.

Authors:  Judith Holler
Journal:  Philos Trans R Soc Lond B Biol Sci       Date:  2022-07-25       Impact factor: 6.671

5.  Multicomponent and multisensory communicative acts in orang-utans may serve different functions.

Authors:  Marlen Fröhlich; Natasha Bartolotta; Caroline Fryns; Colin Wagner; Laurene Momon; Marvin Jaffrezic; Tatang Mitra Setia; Maria A van Noordwijk; Carel P van Schaik
Journal:  Commun Biol       Date:  2021-07-27

6.  Cross-Linguistic Trade-Offs and Causal Relationships Between Cues to Grammatical Subject and Object, and the Problem of Efficiency-Related Explanations.

Authors:  Natalia Levshina
Journal:  Front Psychol       Date:  2021-07-12
  6 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.