Literature DB >> 15221173

Semantic congruence is a critical factor in multisensory behavioral performance.

Paul J Laurienti1, Robert A Kraft, Joseph A Maldjian, Jonathan H Burdette, Mark T Wallace.   

Abstract

It has repeatedly been demonstrated that the presence of multiple cues in different sensory modalities can enhance behavioral performance by speeding responses, increasing accuracy, and/or improving stimulus detection. Despite an extensive knowledge base as to how the spatial, temporal, and physical (eg., intensity) characteristics of multisensory stimuli influence such enhancements, little is known about the role of semantic or contextual congruence. Our hypothesis was that semantically congruent multisensory stimuli would result in enhanced behavioral performance, and that semantically incongruent multisensory stimuli would result in either no enhancement or a decrement in behavioral performance. The results from a redundant cue feature discrimination task clearly demonstrate that congruent cross-modal stimulation improves behavioral performance. This effect is specific to the multisensory stimuli, as no improvements are seen in the presence of redundant unimodal stimulus pairs. In contrast, incongruent stimulus pairs result in behavioral decrements for both multisensory and paired unimodal stimuli. These results highlight that in addition to such simple stimulus features as space, time and relative effectiveness, the semantic content of a multisensory stimulus plays a critical role in determining how it is processed by the nervous system.

Mesh:

Year:  2004        PMID: 15221173     DOI: 10.1007/s00221-004-1913-2

Source DB:  PubMed          Journal:  Exp Brain Res        ISSN: 0014-4819            Impact factor:   1.972


  34 in total

1.  Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex.

Authors:  G A Calvert; R Campbell; M J Brammer
Journal:  Curr Biol       Date:  2000-06-01       Impact factor: 10.834

2.  Cross-modal sensory processing in the anterior cingulate and medial prefrontal cortices.

Authors:  Paul J Laurienti; Mark T Wallace; Joseph A Maldjian; Christina M Susi; Barry E Stein; Jonathan H Burdette
Journal:  Hum Brain Mapp       Date:  2003-08       Impact factor: 5.038

3.  Neural correlates of cross-modal binding.

Authors:  Khalafalla O Bushara; Takashi Hanakawa; Ilka Immisch; Keiichiro Toma; Kenji Kansaku; Mark Hallett
Journal:  Nat Neurosci       Date:  2003-02       Impact factor: 24.884

4.  Hearing lips and seeing voices.

Authors:  H McGurk; J MacDonald
Journal:  Nature       Date:  1976 Dec 23-30       Impact factor: 49.962

5.  Cross-modal, auditory-visual Stroop interference: a reply to Cowan and Barron (1987).

Authors:  C Miles; C Madden; D M Jones
Journal:  Percept Psychophys       Date:  1989-01

6.  The reality of cross-modal Stroop effects.

Authors:  N Cowan
Journal:  Percept Psychophys       Date:  1989-01

7.  Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the BOLD effect.

Authors:  G A Calvert; P C Hansen; S D Iversen; M J Brammer
Journal:  Neuroimage       Date:  2001-08       Impact factor: 6.556

8.  Divided attention: evidence for coactivation with redundant signals.

Authors:  J Miller
Journal:  Cogn Psychol       Date:  1982-04       Impact factor: 3.468

9.  Cross-modal perceptual integration of spatially and temporally disparate auditory and visual stimuli.

Authors:  Jörg Lewald; Rainer Guski
Journal:  Brain Res Cogn Brain Res       Date:  2003-05

10.  An irrelevant light enhances auditory detection in humans: a psychophysical analysis of multisensory integration in stimulus detection.

Authors:  Christopher T Lovelace; Barry E Stein; Mark T Wallace
Journal:  Brain Res Cogn Brain Res       Date:  2003-07
View more
  71 in total

1.  Perceptual decisions formed by accumulation of audiovisual evidence in prefrontal cortex.

Authors:  Uta Noppeney; Dirk Ostwald; Sebastian Werner
Journal:  J Neurosci       Date:  2010-05-26       Impact factor: 6.167

2.  Cross-modal perceptual load: the impact of modality and individual differences.

Authors:  Rajwant Sandhu; Benjamin James Dyson
Journal:  Exp Brain Res       Date:  2015-12-15       Impact factor: 1.972

3.  Semantic Integration and Age of Acquisition Effects in Code-Blend Comprehension.

Authors:  Marcel R Giezen; Karen Emmorey
Journal:  J Deaf Stud Deaf Educ       Date:  2015-12-10

Review 4.  A multisensory perspective on object memory.

Authors:  Pawel J Matusz; Mark T Wallace; Micah M Murray
Journal:  Neuropsychologia       Date:  2017-04-08       Impact factor: 3.139

5.  Rapid brain discrimination of sounds of objects.

Authors:  Micah M Murray; Christian Camen; Sara L Gonzalez Andino; Pierre Bovet; Stephanie Clarke
Journal:  J Neurosci       Date:  2006-01-25       Impact factor: 6.167

6.  Modality-specific selective attention attenuates multisensory integration.

Authors:  Jennifer L Mozolic; Christina E Hugenschmidt; Ann M Peiffer; Paul J Laurienti
Journal:  Exp Brain Res       Date:  2007-08-08       Impact factor: 1.972

7.  Catch the moment: multisensory enhancement of rapid visual events by sound.

Authors:  Yi-Chuan Chen; Su-Ling Yeh
Journal:  Exp Brain Res       Date:  2009-05-15       Impact factor: 1.972

8.  Integration of auditory and visual information in the recognition of realistic objects.

Authors:  Clara Suied; Nicolas Bonneel; Isabelle Viaud-Delmon
Journal:  Exp Brain Res       Date:  2008-12-18       Impact factor: 1.972

9.  Contextual control of audiovisual integration in low-level sensory cortices.

Authors:  Nienke M van Atteveldt; Bradley S Peterson; Charles E Schroeder
Journal:  Hum Brain Mapp       Date:  2013-08-24       Impact factor: 5.038

10.  Neural processing of asynchronous audiovisual speech perception.

Authors:  Ryan A Stevenson; Nicholas A Altieri; Sunah Kim; David B Pisoni; Thomas W James
Journal:  Neuroimage       Date:  2010-02-15       Impact factor: 6.556

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.