Literature DB >> 21544260

Visual speech primes open-set recognition of spoken words.

Adam B Buchwald1, Stephen J Winters, David B Pisoni.   

Abstract

Visual speech perception has become a topic of considerable interest to speech researchers. Previous research has demonstrated that perceivers neurally encode and use speech information from the visual modality, and this information has been found to facilitate spoken word recognition in tasks such as lexical decision (Kim, Davis, & Krins, 2004). In this paper, we used a cross-modality repetition priming paradigm with visual speech lexical primes and auditory lexical targets to explore the nature of this priming effect. First, we report that participants identified spoken words mixed with noise more accurately when the words were preceded by a visual speech prime of the same word compared with a control condition. Second, analyses of the responses indicated that both correct and incorrect responses were constrained by the visual speech information in the prime. These complementary results suggest that the visual speech primes have an effect on lexical access by increasing the likelihood that words with certain phonetic properties are selected. Third, we found that the cross-modality repetition priming effect was maintained even when visual and auditory signals came from different speakers, and thus different instances of the same lexical item. We discuss implications of these results for current theories of speech perception.

Entities:  

Year:  2009        PMID: 21544260      PMCID: PMC3085279          DOI: 10.1080/01690960802536357

Source DB:  PubMed          Journal:  Lang Cogn Process        ISSN: 0169-0965


  40 in total

1.  Phonotactics, neighborhood activation, and lexical access for spoken words.

Authors:  M S Vitevitch; P A Luce; D B Pisoni; E T Auer
Journal:  Brain Lang       Date:  1999 Jun 1-15       Impact factor: 2.381

2.  Stimulus-based lexical distinctiveness as a general word-recognition mechanism.

Authors:  Sven L Mattys; Lynne E Bernstein; Edward T Auer
Journal:  Percept Psychophys       Date:  2002-05

3.  Audio-visual interactions with intact clearly audible speech.

Authors:  Chris Davis; Jeesun Kim
Journal:  Q J Exp Psychol A       Date:  2004-08

4.  Cross-modal source information and spoken word recognition.

Authors:  Lorin Lachs; David B Pisoni
Journal:  J Exp Psychol Hum Percept Perform       Date:  2004-04       Impact factor: 3.332

5.  Visual speech speeds up the neural processing of auditory speech.

Authors:  Virginie van Wassenhove; Ken W Grant; David Poeppel
Journal:  Proc Natl Acad Sci U S A       Date:  2005-01-12       Impact factor: 11.205

6.  Crossmodal Source Identification in Speech Perception.

Authors:  Lorin Lachs; David B Pisoni
Journal:  Ecol Psychol       Date:  2004

7.  Speechreading and the structure of the lexicon: computationally modeling the effects of reduced phonetic distinctiveness on lexical uniqueness.

Authors:  E T Auer; L E Bernstein
Journal:  J Acoust Soc Am       Date:  1997-12       Impact factor: 1.840

8.  A masking noise with speech-envelope characteristics for studying intelligibility.

Authors:  Y Horii; A S House; G W Hughes
Journal:  J Acoust Soc Am       Date:  1971-06       Impact factor: 1.840

9.  Use of visual information for phonetic perception.

Authors:  Q Summerfield
Journal:  Phonetica       Date:  1979       Impact factor: 1.759

10.  The motor theory of speech perception revised.

Authors:  A M Liberman; I G Mattingly
Journal:  Cognition       Date:  1985-10
View more
  7 in total

1.  The Role of Auditory and Visual Speech in Word Learning at 18 Months and in Adulthood.

Authors:  Mélanie Havy; Afra Foroud; Laurel Fais; Janet F Werker
Journal:  Child Dev       Date:  2017-01-26

2.  Different neural processes underlie visual speech perception in school-age children and adults: An event-related potentials study.

Authors:  Natalya Kaganovich; Elizabeth Ancel
Journal:  J Exp Child Psychol       Date:  2019-04-20

3.  More than words: word predictability, prosody, gesture and mouth movements in natural language comprehension.

Authors:  Ye Zhang; Diego Frassinelli; Jyrki Tuomainen; Jeremy I Skipper; Gabriella Vigliocco
Journal:  Proc Biol Sci       Date:  2021-07-21       Impact factor: 5.349

4.  Learning Spoken Words via the Ears and Eyes: Evidence from 30-Month-Old Children.

Authors:  Mélanie Havy; Pascal Zesiger
Journal:  Front Psychol       Date:  2017-12-08

5.  Speechreading in hearing children can be improved by training.

Authors:  Elizabeth Buchanan-Worster; Charles Hulme; Rachel Dennan; Mairéad MacSweeney
Journal:  Dev Sci       Date:  2021-06-01

6.  Impaired Audiovisual Representation of Phonemes in Children with Developmental Language Disorder.

Authors:  Natalya Kaganovich; Jennifer Schumaker; Sharon Christ
Journal:  Brain Sci       Date:  2021-04-16

7.  Lexical Effects on the Perceived Clarity of Noise-Vocoded Speech in Younger and Older Listeners.

Authors:  Terrin N Tamati; Victoria A Sevich; Emily M Clausing; Aaron C Moberly
Journal:  Front Psychol       Date:  2022-04-01
  7 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.