Literature DB >> 20424055

Two sides of the same coin: speech and gesture mutually interact to enhance comprehension.

Spencer D Kelly1, Asli Ozyürek, Eric Maris.   

Abstract

Gesture and speech are assumed to form an integrated system during language production. Based on this view, we propose the integrated-systems hypothesis, which explains two ways in which gesture and speech are integrated--through mutual and obligatory interactions--in language comprehension. Experiment 1 presented participants with action primes (e.g., someone chopping vegetables) and bimodal speech and gesture targets. Participants related primes to targets more quickly and accurately when they contained congruent information (speech: "chop"; gesture: chop) than when they contained incongruent information (speech: "chop"; gesture: twist). Moreover, the strength of the incongruence affected processing, with fewer errors for weak incongruities (speech: "chop"; gesture: cut) than for strong incongruities (speech: "chop"; gesture: twist). Crucial for the integrated-systems hypothesis, this influence was bidirectional. Experiment 2 demonstrated that gesture's influence on speech was obligatory. The results confirm the integrated-systems hypothesis and demonstrate that gesture and speech form an integrated system in language comprehension.

Entities:  

Mesh:

Year:  2009        PMID: 20424055     DOI: 10.1177/0956797609357327

Source DB:  PubMed          Journal:  Psychol Sci        ISSN: 0956-7976


  53 in total

1.  Neural integration of speech and gesture in schizophrenia: evidence for differential processing of metaphoric gestures.

Authors:  Benjamin Straube; Antonia Green; Katharina Sass; André Kirner-Veselinovic; Tilo Kircher
Journal:  Hum Brain Mapp       Date:  2012-02-29       Impact factor: 5.038

2.  Bilingual processing of ASL-English code-blends: The consequences of accessing two lexical representations simultaneously.

Authors:  Karen Emmorey; Jennifer Petrich; Tamar H Gollan
Journal:  J Mem Lang       Date:  2012-05-05       Impact factor: 3.059

3.  Semantic Integration and Age of Acquisition Effects in Code-Blend Comprehension.

Authors:  Marcel R Giezen; Karen Emmorey
Journal:  J Deaf Stud Deaf Educ       Date:  2015-12-10

4.  Gesturing has a larger impact on problem-solving than action, even when action is accompanied by words.

Authors:  Caroline Trofatter; Carly Kontra; Sian Beilock; Susan Goldin-Meadow
Journal:  Lang Cogn Neurosci       Date:  2015-03       Impact factor: 2.331

5.  Nonverbal social communication and gesture control in schizophrenia.

Authors:  Sebastian Walther; Katharina Stegmayer; Jeanne Sulzbacher; Tim Vanbellingen; René Müri; Werner Strik; Stephan Bohlhalter
Journal:  Schizophr Bull       Date:  2015-02-01       Impact factor: 9.306

6.  Actions speak louder than gestures when you are 2 years old.

Authors:  Miriam A Novack; Courtney A Filippi; Susan Goldin-Meadow; Amanda L Woodward
Journal:  Dev Psychol       Date:  2018-10

7.  Beyond words: evidence for automatic language-gesture integration of symbolic gestures but not dynamic landscapes.

Authors:  Dana Vainiger; Ludovica Labruna; Richard B Ivry; Michal Lavidor
Journal:  Psychol Res       Date:  2013-01-10

8.  The processing of speech, gesture, and action during language comprehension.

Authors:  Spencer Kelly; Meghan Healey; Asli Özyürek; Judith Holler
Journal:  Psychon Bull Rev       Date:  2015-04

9.  Eye'm talking to you: speakers' gaze direction modulates co-speech gesture processing in the right MTG.

Authors:  Judith Holler; Idil Kokal; Ivan Toni; Peter Hagoort; Spencer D Kelly; Aslı Özyürek
Journal:  Soc Cogn Affect Neurosci       Date:  2014-03-19       Impact factor: 3.436

10.  Applauding with closed hands: neural signature of action-sentence compatibility effects.

Authors:  Pia Aravena; Esteban Hurtado; Rodrigo Riveros; Juan Felipe Cardona; Facundo Manes; Agustín Ibáñez
Journal:  PLoS One       Date:  2010-07-28       Impact factor: 3.240

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.