Literature DB >> 20143899

Natural cross-modal mappings between visual and auditory features.

Karla K Evans1, Anne Treisman.   

Abstract

The brain may combine information from different sense modalities to enhance the speed and accuracy of detection of objects and events, and the choice of appropriate responses. There is mounting evidence that perceptual experiences that appear to be modality-specific are also influenced by activity from other sensory modalities, even in the absence of awareness of this interaction. In a series of speeded classification tasks, we found spontaneous mappings between the auditory feature of pitch and the visual features of vertical location, size, and spatial frequency but not contrast. By dissociating the task variables from the features that were cross-modally related, we find that the interactions happen in an automatic fashion and are possibly located at the perceptual level.

Entities:  

Mesh:

Year:  2010        PMID: 20143899      PMCID: PMC2920420          DOI: 10.1167/10.1.6

Source DB:  PubMed          Journal:  J Vis        ISSN: 1534-7362            Impact factor:   2.240


  19 in total

1.  Perceptual and linguistic interactions in speeded classification: tests of the semantic coding hypothesis.

Authors:  G Martino; L E Marks
Journal:  Perception       Date:  1999       Impact factor: 1.490

2.  Psychophysical investigations into the neural basis of synaesthesia.

Authors:  V S Ramachandran; E M Hubbard
Journal:  Proc Biol Sci       Date:  2001-05-07       Impact factor: 5.349

3.  Processes underlying dimensional interactions: correspondences between linguistic and nonlinguistic dimensions.

Authors:  R D Melara; L E Marks
Journal:  Mem Cognit       Date:  1990-09

4.  Dimensional interaction between color and pitch.

Authors:  R D Melara
Journal:  J Exp Psychol Hum Percept Perform       Date:  1989-02       Impact factor: 3.332

5.  On cross-modal similarity: the perceptual structure of pitch, loudness, and brightness.

Authors:  L E Marks
Journal:  J Exp Psychol Hum Percept Perform       Date:  1989-08       Impact factor: 3.332

6.  Spatial representation of pitch height: the SMARC effect.

Authors:  Elena Rusconi; Bonnie Kwan; Bruno L Giordano; Carlo Umiltà; Brian Butterworth
Journal:  Cognition       Date:  2005-05-31

7.  The influence of irrelevant location information on performance: A review of the Simon and spatial Stroop effects.

Authors:  C H Lu; R W Proctor
Journal:  Psychon Bull Rev       Date:  1995-06

8.  The Psychophysics Toolbox.

Authors:  D H Brainard
Journal:  Spat Vis       Date:  1997

9.  On cross-modal similarity: auditory-visual interactions in speeded discrimination.

Authors:  L E Marks
Journal:  J Exp Psychol Hum Percept Perform       Date:  1987-08       Impact factor: 3.332

10.  Perceiving similarity and comprehending metaphor.

Authors:  L E Marks; R J Hammeal; M H Bornstein
Journal:  Monogr Soc Res Child Dev       Date:  1987
View more
  77 in total

1.  Visuoauditory mappings between high luminance and high pitch are shared by chimpanzees (Pan troglodytes) and humans.

Authors:  Vera U Ludwig; Ikuma Adachi; Tetsuro Matsuzawa
Journal:  Proc Natl Acad Sci U S A       Date:  2011-12-05       Impact factor: 11.205

2.  Audiovisual crossmodal correspondences and sound symbolism: a study using the implicit association test.

Authors:  Cesare V Parise; Charles Spence
Journal:  Exp Brain Res       Date:  2012-06-17       Impact factor: 1.972

3.  Effect of pitch-space correspondence on sound-induced visual motion perception.

Authors:  Souta Hidaka; Wataru Teramoto; Mirjam Keetels; Jean Vroomen
Journal:  Exp Brain Res       Date:  2013-09-13       Impact factor: 1.972

4.  Changes in auditory frequency guide visual-spatial attention.

Authors:  Julia A Mossbridge; Marcia Grabowecky; Satoru Suzuki
Journal:  Cognition       Date:  2011-07-08

5.  Differential coding of perception in the world's languages.

Authors:  Asifa Majid; Seán G Roberts; Ludy Cilissen; Karen Emmorey; Brenda Nicodemus; Lucinda O'Grady; Bencie Woll; Barbara LeLan; Hilário de Sousa; Brian L Cansler; Shakila Shayan; Connie de Vos; Gunter Senft; N J Enfield; Rogayah A Razak; Sebastian Fedden; Sylvia Tufvesson; Mark Dingemanse; Ozge Ozturk; Penelope Brown; Clair Hill; Olivier Le Guen; Vincent Hirtzel; Rik van Gijn; Mark A Sicoli; Stephen C Levinson
Journal:  Proc Natl Acad Sci U S A       Date:  2018-11-06       Impact factor: 11.205

6.  Audiovisual time perception is spatially specific.

Authors:  James Heron; Neil W Roach; James V M Hanson; Paul V McGraw; David Whitaker
Journal:  Exp Brain Res       Date:  2012-02-25       Impact factor: 1.972

Review 7.  Crossmodal correspondences between odors and contingent features: odors, musical notes, and geometrical shapes.

Authors:  Ophelia Deroy; Anne-Sylvie Crisinel; Charles Spence
Journal:  Psychon Bull Rev       Date:  2013-10

Review 8.  Why we are not all synesthetes (not even weakly so).

Authors:  Ophelia Deroy; Charles Spence
Journal:  Psychon Bull Rev       Date:  2013-08

9.  Auditory rhythms are systemically associated with spatial-frequency and density information in visual scenes.

Authors:  Aleksandra Sherman; Marcia Grabowecky; Satoru Suzuki
Journal:  Psychon Bull Rev       Date:  2013-08

10.  Synesthesia strengthens sound-symbolic cross-modal correspondences.

Authors:  Simon Lacey; Margaret Martinez; Kelly McCormick; K Sathian
Journal:  Eur J Neurosci       Date:  2016-09-15       Impact factor: 3.386

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.