Literature DB >> 22648604

Does crossmodal correspondence modulate the facilitatory effect of auditory cues on visual search?

Anna Klapetek1, Mary Kim Ngo, Charles Spence.   

Abstract

The "pip-and-pop effect" refers to the facilitation of search for a visual target (a horizontal or vertical bar whose color changes frequently) among multiple visual distractors (tilted bars also changing color unpredictably) by the presentation of a spatially uninformative auditory cue synchronized with the color change of the visual target. In the present study, the visual stimuli in the search display changed brightness instead of color, and the crossmodal congruency between the pitch of the auditory cue and the brightness of the visual target was manipulated. When cue presence and cue congruency were randomly varied between trials (Experiment 1), both congruent cues (low-frequency tones synchronized with dark target states or high-frequency tones synchronized with bright target states) and incongruent cues (the reversed mapping) facilitated visual search performance equally, relative to a no-cue baseline condition. However, when cue congruency was blocked and the participants were informed about the pitch-brightness mapping in the cue-present blocks (Experiment 2), performance was significantly enhanced when the cue and target were crossmodally congruent as compared to when they were incongruent. These results therefore suggest that the crossmodal congruency between auditory pitch and visual brightness can influence performance in the pip-and-pop task by means of top-down facilitation.

Entities:  

Mesh:

Year:  2012        PMID: 22648604     DOI: 10.3758/s13414-012-0317-9

Source DB:  PubMed          Journal:  Atten Percept Psychophys        ISSN: 1943-3921            Impact factor:   2.199


  18 in total

1.  Audiovisual crossmodal correspondences and sound symbolism: a study using the implicit association test.

Authors:  Cesare V Parise; Charles Spence
Journal:  Exp Brain Res       Date:  2012-06-17       Impact factor: 1.972

2.  Effect of pitch-space correspondence on sound-induced visual motion perception.

Authors:  Souta Hidaka; Wataru Teramoto; Mirjam Keetels; Jean Vroomen
Journal:  Exp Brain Res       Date:  2013-09-13       Impact factor: 1.972

Review 3.  Crossmodal correspondences between odors and contingent features: odors, musical notes, and geometrical shapes.

Authors:  Ophelia Deroy; Anne-Sylvie Crisinel; Charles Spence
Journal:  Psychon Bull Rev       Date:  2013-10

Review 4.  Why we are not all synesthetes (not even weakly so).

Authors:  Ophelia Deroy; Charles Spence
Journal:  Psychon Bull Rev       Date:  2013-08

Review 5.  The COGs (context, object, and goals) in multisensory processing.

Authors:  Sanne ten Oever; Vincenzo Romei; Nienke van Atteveldt; Salvador Soto-Faraco; Micah M Murray; Pawel J Matusz
Journal:  Exp Brain Res       Date:  2016-03-01       Impact factor: 1.972

6.  Summation of visual attributes in auditory-visual crossmodal correspondences.

Authors:  Clare Jonas; Mary Jane Spiller; Paul Hibbard
Journal:  Psychon Bull Rev       Date:  2017-08

7.  Using an auditory sensory substitution device to augment vision: evidence from eye movements.

Authors:  Thomas D Wright; Aaron Margolis; Jamie Ward
Journal:  Exp Brain Res       Date:  2014-12-16       Impact factor: 1.972

8.  Multisensory perception in Argus II retinal prosthesis patients: Leveraging auditory-visual mappings to enhance prosthesis outcomes.

Authors:  Noelle R B Stiles; Vivek R Patel; James D Weiland
Journal:  Vision Res       Date:  2021-02-17       Impact factor: 1.886

9.  Crossmodal interactions during affective picture processing.

Authors:  Vera Ferrari; Serena Mastria; Nicola Bruno
Journal:  PLoS One       Date:  2014-02-27       Impact factor: 3.240

10.  It does belong together: cross-modal correspondences influence cross-modal integration during perceptual learning.

Authors:  Lionel Brunel; Paulo F Carvalho; Robert L Goldstone
Journal:  Front Psychol       Date:  2015-04-09
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.