Literature DB >> 22633004

Sounds exaggerate visual shape.

Timothy D Sweeny1, Emmanuel Guzman-Martinez, Laura Ortega, Marcia Grabowecky, Satoru Suzuki.   

Abstract

While perceiving speech, people see mouth shapes that are systematically associated with sounds. In particular, a vertically stretched mouth produces a /woo/ sound, whereas a horizontally stretched mouth produces a /wee/ sound. We demonstrate that hearing these speech sounds alters how we see aspect ratio, a basic visual feature that contributes to perception of 3D space, objects and faces. Hearing a /woo/ sound increases the apparent vertical elongation of a shape, whereas hearing a /wee/ sound increases the apparent horizontal elongation. We further demonstrate that these sounds influence aspect ratio coding. Viewing and adapting to a tall (or flat) shape makes a subsequently presented symmetric shape appear flat (or tall). These aspect ratio aftereffects are enhanced when associated speech sounds are presented during the adaptation period, suggesting that the sounds influence visual population coding of aspect ratio. Taken together, these results extend previous demonstrations that visual information constrains auditory perception by showing the converse - speech sounds influence visual perception of a basic geometric feature.
Copyright © 2012 Elsevier B.V. All rights reserved.

Entities:  

Mesh:

Year:  2012        PMID: 22633004      PMCID: PMC3383334          DOI: 10.1016/j.cognition.2012.04.009

Source DB:  PubMed          Journal:  Cognition        ISSN: 0010-0277


  35 in total

Review 1.  Recognizing depth-rotated objects: a review of recent research and theory.

Authors:  I Biederman
Journal:  Spat Vis       Date:  2000

2.  Speech listening specifically modulates the excitability of tongue muscles: a TMS study.

Authors:  Luciano Fadiga; Laila Craighero; Giovanni Buccino; Giacomo Rizzolatti
Journal:  Eur J Neurosci       Date:  2002-01       Impact factor: 3.386

3.  Attentional selection of overlapped shapes: a study using brief shape aftereffects.

Authors:  Satoru Suzuki
Journal:  Vision Res       Date:  2003-03       Impact factor: 1.886

4.  Internal curvature signal and noise in low- and high-level vision.

Authors:  Timothy D Sweeny; Marcia Grabowecky; Yee Joon Kim; Satoru Suzuki
Journal:  J Neurophysiol       Date:  2011-01-05       Impact factor: 2.714

5.  Hearing lips and seeing voices: how cortical areas supporting speech production mediate audiovisual speech perception.

Authors:  Jeremy I Skipper; Virginie van Wassenhove; Howard C Nusbaum; Steven L Small
Journal:  Cereb Cortex       Date:  2007-01-11       Impact factor: 5.357

6.  Multisensory synesthetic interactions in the speeded classification of visual size.

Authors:  Alberto Gallace; Charles Spence
Journal:  Percept Psychophys       Date:  2006-10

7.  Dynamic changes in superior temporal sulcus connectivity during perception of noisy audiovisual speech.

Authors:  Audrey R Nath; Michael S Beauchamp
Journal:  J Neurosci       Date:  2011-02-02       Impact factor: 6.167

8.  Laughter exaggerates happy and sad faces depending on visual context.

Authors:  Aleksandra Sherman; Timothy D Sweeny; Marcia Grabowecky; Satoru Suzuki
Journal:  Psychon Bull Rev       Date:  2012-04

9.  Auditory-visual crossmodal integration in perception of face gender.

Authors:  Eric L Smith; Marcia Grabowecky; Satoru Suzuki
Journal:  Curr Biol       Date:  2007-09-06       Impact factor: 10.834

10.  'When birds of a feather flock together': synesthetic correspondences modulate audiovisual integration in non-synesthetes.

Authors:  Cesare Valerio Parise; Charles Spence
Journal:  PLoS One       Date:  2009-05-27       Impact factor: 3.240

View more
  7 in total

1.  Effect of pitch-space correspondence on sound-induced visual motion perception.

Authors:  Souta Hidaka; Wataru Teramoto; Mirjam Keetels; Jean Vroomen
Journal:  Exp Brain Res       Date:  2013-09-13       Impact factor: 1.972

2.  Vision perceptually restores auditory spectral dynamics in speech.

Authors:  John Plass; David Brang; Satoru Suzuki; Marcia Grabowecky
Journal:  Proc Natl Acad Sci U S A       Date:  2020-07-06       Impact factor: 11.205

3.  Sharp and round shapes of seen objects have distinct influences on vowel and consonant articulation.

Authors:  L Vainio; M Tiainen; K Tiippana; A Rantala; M Vainio
Journal:  Psychol Res       Date:  2016-06-15

4.  Auditory rhythms are systemically associated with spatial-frequency and density information in visual scenes.

Authors:  Aleksandra Sherman; Marcia Grabowecky; Satoru Suzuki
Journal:  Psychon Bull Rev       Date:  2013-08

5.  Hearing mouth shapes: Sound symbolism and the reverse McGurk effect.

Authors:  Charles Spence; Ophelia Deroy
Journal:  Iperception       Date:  2012-09-17

6.  The Content of Imagined Sounds Changes Visual Motion Perception in the Cross-Bounce Illusion.

Authors:  Christopher C Berger; H Henrik Ehrsson
Journal:  Sci Rep       Date:  2017-01-10       Impact factor: 4.379

7.  Audiovisual correspondence between musical timbre and visual shapes.

Authors:  Mohammad Adeli; Jean Rouat; Stéphane Molotchnikoff
Journal:  Front Hum Neurosci       Date:  2014-05-30       Impact factor: 3.169

  7 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.