Literature DB >> 27011021

What you see isn't always what you get: Auditory word signals trump consciously perceived words in lexical access.

Rachel Ostrand1, Sheila E Blumstein2, Victor S Ferreira3, James L Morgan2.   

Abstract

Human speech perception often includes both an auditory and visual component. A conflict in these signals can result in the McGurk illusion, in which the listener perceives a fusion of the two streams, implying that information from both has been integrated. We report two experiments investigating whether auditory-visual integration of speech occurs before or after lexical access, and whether the visual signal influences lexical access at all. Subjects were presented with McGurk or Congruent primes and performed a lexical decision task on related or unrelated targets. Although subjects perceived the McGurk illusion, McGurk and Congruent primes with matching real-word auditory signals equivalently primed targets that were semantically related to the auditory signal, but not targets related to the McGurk percept. We conclude that the time course of auditory-visual integration is dependent on the lexicality of the auditory and visual input signals, and that listeners can lexically access one word and yet consciously perceive another.
Copyright © 2016 Elsevier B.V. All rights reserved.

Entities:  

Keywords:  Auditory–visual integration; Lexical access; McGurk effect; Multisensory perception

Mesh:

Year:  2016        PMID: 27011021      PMCID: PMC4850493          DOI: 10.1016/j.cognition.2016.02.019

Source DB:  PubMed          Journal:  Cognition        ISSN: 0010-0277


  22 in total

1.  Bimodal speech: early suppressive visual effects in human auditory cortex.

Authors:  Julien Besle; Alexandra Fort; Claude Delpuech; Marie-Hélène Giard
Journal:  Eur J Neurosci       Date:  2004-10       Impact factor: 3.386

2.  Hearing lips and seeing voices.

Authors:  H McGurk; J MacDonald
Journal:  Nature       Date:  1976 Dec 23-30       Impact factor: 49.962

3.  Crossmodal integration in the identification of consonant segments.

Authors:  L D Braida
Journal:  Q J Exp Psychol A       Date:  1991-08

4.  Temporal constraints on the McGurk effect.

Authors:  K G Munhall; P Gribble; L Sacco; M Ward
Journal:  Percept Psychophys       Date:  1996-04

5.  Perceptual distance and competition in lexical access.

Authors:  W Marslen-Wilson; H E Moss; S van Halen
Journal:  J Exp Psychol Hum Percept Perform       Date:  1996-12       Impact factor: 3.332

6.  The locus of the effects of sentential-semantic context in spoken-word processing.

Authors:  P Zwitserlood
Journal:  Cognition       Date:  1989-06

7.  Functional parallelism in spoken word-recognition.

Authors:  W D Marslen-Wilson
Journal:  Cognition       Date:  1987-03

8.  Selective adaptation in speech perception using a compelling audiovisual adaptor.

Authors:  H M Saldaña; L D Rosenblum
Journal:  J Acoust Soc Am       Date:  1994-06       Impact factor: 1.840

9.  Audiovisual presentation demonstrates that selective adaptation in speech perception is purely auditory.

Authors:  M Roberts; Q Summerfield
Journal:  Percept Psychophys       Date:  1981-10

10.  Auditory-visual perception of speech.

Authors:  N P Erber
Journal:  J Speech Hear Disord       Date:  1975-11
View more
  3 in total

1.  Inferior Frontal Cortex Contributions to the Recognition of Spoken Words and Their Constituent Speech Sounds.

Authors:  Jack C Rogers; Matthew H Davis
Journal:  J Cogn Neurosci       Date:  2017-01-27       Impact factor: 3.225

2.  Audiovisual and lexical cues do not additively enhance perceptual adaptation.

Authors:  Shruti Ullas; Elia Formisano; Frank Eisner; Anne Cutler
Journal:  Psychon Bull Rev       Date:  2020-08

3.  What accounts for individual differences in susceptibility to the McGurk effect?

Authors:  Violet A Brown; Maryam Hedayati; Annie Zanger; Sasha Mayn; Lucia Ray; Naseem Dillman-Hasso; Julia F Strand
Journal:  PLoS One       Date:  2018-11-12       Impact factor: 3.240

  3 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.