Literature DB >> 24141035

Degrading phonetic information affects matching of audiovisual speech in adults, but not in infants.

Martijn Baart1, Jean Vroomen, Kathleen Shaw, Heather Bortfeld.   

Abstract

Infants and adults are well able to match auditory and visual speech, but the cues on which they rely (viz. temporal, phonetic and energetic correspondence in the auditory and visual speech streams) may differ. Here we assessed the relative contribution of the different cues using sine-wave speech (SWS). Adults (N=52) and infants (N=34, age ranged in between 5 and 15months) matched 2 trisyllabic speech sounds ('kalisu' and 'mufapi'), either natural or SWS, with visual speech information. On each trial, adults saw two articulating faces and matched a sound to one of these, while infants were presented the same stimuli in a preferential looking paradigm. Adults' performance was almost flawless with natural speech, but was significantly less accurate with SWS. In contrast, infants matched the sound to the articulating face equally well for natural speech and SWS. These results suggest that infants rely to a lesser extent on phonetic cues than adults do to match audio to visual speech. This is in line with the notion that the ability to extract phonetic information from the visual signal increases during development, and suggests that phonetic knowledge might not be the basis for early audiovisual correspondence detection in speech.
Copyright © 2013 Elsevier B.V. All rights reserved.

Entities:  

Keywords:  Adults; Audiovisual speech integration; Infants; Phonetic correspondence; Sine-wave speech

Mesh:

Year:  2013        PMID: 24141035      PMCID: PMC3904288          DOI: 10.1016/j.cognition.2013.09.006

Source DB:  PubMed          Journal:  Cognition        ISSN: 0010-0277


  45 in total

1.  Neural correlates of multisensory integration of ecologically valid audiovisual events.

Authors:  Jeroen J Stekelenburg; Jean Vroomen
Journal:  J Cogn Neurosci       Date:  2007-12       Impact factor: 3.225

2.  Phonetic recalibration only occurs in speech mode.

Authors:  Jean Vroomen; Martijn Baart
Journal:  Cognition       Date:  2008-12-06

3.  An exploration of why preschoolers perform differently than do adults in audiovisual speech perception tasks.

Authors:  R N Desjardins; J Rogers; J F Werker
Journal:  J Exp Child Psychol       Date:  1997-07

4.  Lip reading in infants: attention to speech presented in- and out-of-synchrony.

Authors:  B Dodd
Journal:  Cogn Psychol       Date:  1979-10       Impact factor: 3.468

5.  Optical brain imaging reveals general auditory and language-specific processing in early infant development.

Authors:  Yasuyo Minagawa-Kawai; Heather van der Lely; Franck Ramus; Yutaka Sato; Reiko Mazuka; Emmanuel Dupoux
Journal:  Cereb Cortex       Date:  2010-05-23       Impact factor: 5.357

6.  Infant perception of audio-visual speech synchrony.

Authors:  David J Lewkowicz
Journal:  Dev Psychol       Date:  2010-01

7.  Electrophysiological evidence of illusory audiovisual speech percept in human infants.

Authors:  Elena Kushnerenko; Tuomas Teinonen; Agnes Volein; Gergely Csibra
Journal:  Proc Natl Acad Sci U S A       Date:  2008-08-05       Impact factor: 11.205

8.  The bimodal perception of speech in infancy.

Authors:  P K Kuhl; A N Meltzoff
Journal:  Science       Date:  1982-12-10       Impact factor: 47.728

9.  Cross-modal speech perception in adults and infants using nonspeech auditory stimuli.

Authors:  P K Kuhl; K A Williams; A N Meltzoff
Journal:  J Exp Psychol Hum Percept Perform       Date:  1991-08       Impact factor: 3.332

10.  Electrophysiological correlates of predictive coding of auditory location in the perception of natural audiovisual events.

Authors:  Jeroen J Stekelenburg; Jean Vroomen
Journal:  Front Integr Neurosci       Date:  2012-05-31
View more
  10 in total

1.  Phonetic matching of auditory and visual speech develops during childhood: evidence from sine-wave speech.

Authors:  Martijn Baart; Heather Bortfeld; Jean Vroomen
Journal:  J Exp Child Psychol       Date:  2014-09-23

2.  Audiovisual Speech Processing in Relationship to Phonological and Vocabulary Skills in First Graders.

Authors:  Liesbeth Gijbels; Jason D Yeatman; Kaylah Lalonde; Adrian K C Lee
Journal:  J Speech Lang Hear Res       Date:  2021-11-04       Impact factor: 2.674

3.  Infants' preference for native audiovisual speech dissociated from congruency preference.

Authors:  Kathleen Shaw; Martijn Baart; Nicole Depowski; Heather Bortfeld
Journal:  PLoS One       Date:  2015-04-30       Impact factor: 3.240

Review 4.  Sources of Confusion in Infant Audiovisual Speech Perception Research.

Authors:  Kathleen E Shaw; Heather Bortfeld
Journal:  Front Psychol       Date:  2015-12-15

5.  Learning Spoken Words via the Ears and Eyes: Evidence from 30-Month-Old Children.

Authors:  Mélanie Havy; Pascal Zesiger
Journal:  Front Psychol       Date:  2017-12-08

6.  Comparison of Gated Audiovisual Speech Identification in Elderly Hearing Aid Users and Elderly Normal-Hearing Individuals: Effects of Adding Visual Cues to Auditory Speech Stimuli.

Authors:  Shahram Moradi; Björn Lidestam; Jerker Rönnberg
Journal:  Trends Hear       Date:  2016-06-17       Impact factor: 3.293

7.  Modeling the Development of Audiovisual Cue Integration in Speech Perception.

Authors:  Laura M Getz; Elke R Nordeen; Sarah C Vrabic; Joseph C Toscano
Journal:  Brain Sci       Date:  2017-03-21

8.  Multisensory Motion Perception in 3-4 Month-Old Infants.

Authors:  Elena Nava; Massimo Grassi; Viola Brenna; Emanuela Croci; Chiara Turati
Journal:  Front Psychol       Date:  2017-11-15

Review 9.  Development of the Mechanisms Underlying Audiovisual Speech Perception Benefit.

Authors:  Kaylah Lalonde; Lynne A Werner
Journal:  Brain Sci       Date:  2021-01-05

10.  Temporal synchrony and audiovisual integration of speech and object stimuli in autism.

Authors:  Elizabeth Smith; Shouling Zhang; Loisa Bennetto
Journal:  Res Autism Spectr Disord       Date:  2017-04-15
  10 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.