Literature DB >> 17196190

The sound of motion in spoken language: visual information conveyed by acoustic properties of speech.

Hadas Shintel1, Howard C Nusbaum.   

Abstract

Language is generally viewed as conveying information through symbols whose form is arbitrarily related to their meaning. This arbitrary relation is often assumed to also characterize the mental representations underlying language comprehension. We explore the idea that visuo-spatial information can be analogically conveyed through acoustic properties of speech and that such information is integrated into an analog perceptual representation as a natural part of comprehension. Listeners heard sentences describing objects, spoken at varying speaking rates. After each sentence, participants saw a picture of an object and judged whether it had been mentioned in the sentence. Participants were faster to recognize the object when motion implied by speaking rate matched the motion implied by the picture. Results suggest that visuo-spatial referential information can be analogically conveyed and represented.

Entities:  

Mesh:

Year:  2006        PMID: 17196190     DOI: 10.1016/j.cognition.2006.11.005

Source DB:  PubMed          Journal:  Cognition        ISSN: 0010-0277


  7 in total

Review 1.  Gesture, sign, and language: The coming of age of sign language and gesture studies.

Authors:  Susan Goldin-Meadow; Diane Brentari
Journal:  Behav Brain Sci       Date:  2015-10-05       Impact factor: 12.579

2.  From action to abstraction: Gesture as a mechanism of change.

Authors:  Susan Goldin-Meadow
Journal:  Dev Rev       Date:  2015-12-01

3.  Auditory rhythms are systemically associated with spatial-frequency and density information in visual scenes.

Authors:  Aleksandra Sherman; Marcia Grabowecky; Satoru Suzuki
Journal:  Psychon Bull Rev       Date:  2013-08

4.  Tone of voice guides word learning in informative referential contexts.

Authors:  Eva Reinisch; Alexandra Jesse; Lynne C Nygaard
Journal:  Q J Exp Psychol (Hove)       Date:  2012-11-08       Impact factor: 2.143

5.  The bouba/kiki effect is robust across cultures and writing systems.

Authors:  Aleksandra Ćwiek; Susanne Fuchs; Christoph Draxler; Eva Liina Asu; Dan Dediu; Katri Hiovain; Shigeto Kawahara; Sofia Koutalidis; Manfred Krifka; Pärtel Lippus; Gary Lupyan; Grace E Oh; Jing Paul; Caterina Petrone; Rachid Ridouane; Sabine Reiter; Nathalie Schümchen; Ádám Szalontai; Özlem Ünal-Logacev; Jochen Zeller; Marcus Perlman; Bodo Winter
Journal:  Philos Trans R Soc Lond B Biol Sci       Date:  2021-11-15       Impact factor: 6.237

6.  Conveying movement in music and prosody.

Authors:  Stephen C Hedger; Howard C Nusbaum; Berthold Hoeckner
Journal:  PLoS One       Date:  2013-10-16       Impact factor: 3.240

7.  Creating a communication system from scratch: gesture beats vocalization hands down.

Authors:  Nicolas Fay; Casey J Lister; T Mark Ellison; Susan Goldin-Meadow
Journal:  Front Psychol       Date:  2014-04-29
  7 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.