Literature DB >> 25258018

Phonetic matching of auditory and visual speech develops during childhood: evidence from sine-wave speech.

Martijn Baart1, Heather Bortfeld2, Jean Vroomen3.   

Abstract

The correspondence between auditory speech and lip-read information can be detected based on a combination of temporal and phonetic cross-modal cues. Here, we determined the point in developmental time at which children start to effectively use phonetic information to match a speech sound with one of two articulating faces. We presented 4- to 11-year-olds (N=77) with three-syllabic sine-wave speech replicas of two pseudo-words that were perceived as non-speech and asked them to match the sounds with the corresponding lip-read video. At first, children had no phonetic knowledge about the sounds, and matching was thus based on the temporal cues that are fully retained in sine-wave speech. Next, we trained all children to perceive the phonetic identity of the sine-wave speech and repeated the audiovisual (AV) matching task. Only at around 6.5 years of age did the benefit of having phonetic knowledge about the stimuli become apparent, thereby indicating that AV matching based on phonetic cues presumably develops more slowly than AV matching based on temporal cues.
Copyright © 2014 Elsevier Inc. All rights reserved.

Entities:  

Keywords:  Audiovisual speech; Cross-modal correspondence; Development; Phonetic cues; Sine-wave speech; Temporal cues

Mesh:

Year:  2014        PMID: 25258018      PMCID: PMC4252499          DOI: 10.1016/j.jecp.2014.08.002

Source DB:  PubMed          Journal:  J Exp Child Psychol        ISSN: 0022-0965


  30 in total

1.  Visual speech speeds up the neural processing of auditory speech.

Authors:  Virginie van Wassenhove; Ken W Grant; David Poeppel
Journal:  Proc Natl Acad Sci U S A       Date:  2005-01-12       Impact factor: 11.205

2.  Phonetic recalibration only occurs in speech mode.

Authors:  Jean Vroomen; Martijn Baart
Journal:  Cognition       Date:  2008-12-06

3.  The relationship between auditory-visual speech perception and language-specific speech perception at the onset of reading instruction in English-speaking children.

Authors:  Doğu Erdener; Denis Burnham
Journal:  J Exp Child Psychol       Date:  2013-06-15

4.  Brain responses to audiovisual speech mismatch in infants are associated with individual differences in looking behaviour.

Authors:  Elena Kushnerenko; Przemyslaw Tomalski; Haiko Ballieux; Helena Ribeiro; Anita Potton; Emma L Axelsson; Elizabeth Murphy; Derek G Moore
Journal:  Eur J Neurosci       Date:  2013-07-28       Impact factor: 3.386

5.  Impaired speech perception in poor readers: evidence from hearing and speech reading.

Authors:  B de Gelder; J Vroomen
Journal:  Brain Lang       Date:  1998-10-01       Impact factor: 2.381

6.  An exploration of why preschoolers perform differently than do adults in audiovisual speech perception tasks.

Authors:  R N Desjardins; J Rogers; J F Werker
Journal:  J Exp Child Psychol       Date:  1997-07

7.  Infant perception of audio-visual speech synchrony.

Authors:  David J Lewkowicz
Journal:  Dev Psychol       Date:  2010-01

8.  Electrophysiological evidence of illusory audiovisual speech percept in human infants.

Authors:  Elena Kushnerenko; Tuomas Teinonen; Agnes Volein; Gergely Csibra
Journal:  Proc Natl Acad Sci U S A       Date:  2008-08-05       Impact factor: 11.205

9.  The bimodal perception of speech in infancy.

Authors:  P K Kuhl; A N Meltzoff
Journal:  Science       Date:  1982-12-10       Impact factor: 47.728

10.  Audiovisual temporal fusion in 6-month-old infants.

Authors:  Franziska Kopp
Journal:  Dev Cogn Neurosci       Date:  2014-01-19       Impact factor: 6.464

View more
  7 in total

1.  The Role of Auditory and Visual Speech in Word Learning at 18 Months and in Adulthood.

Authors:  Mélanie Havy; Afra Foroud; Laurel Fais; Janet F Werker
Journal:  Child Dev       Date:  2017-01-26

2.  Infants' preference for native audiovisual speech dissociated from congruency preference.

Authors:  Kathleen Shaw; Martijn Baart; Nicole Depowski; Heather Bortfeld
Journal:  PLoS One       Date:  2015-04-30       Impact factor: 3.240

3.  Developmental trends in the facilitation of multisensory objects with distractors.

Authors:  Harriet C Downing; Ayla Barutchu; Sheila G Crewther
Journal:  Front Psychol       Date:  2015-01-20

Review 4.  Sources of Confusion in Infant Audiovisual Speech Perception Research.

Authors:  Kathleen E Shaw; Heather Bortfeld
Journal:  Front Psychol       Date:  2015-12-15

5.  Atypical audiovisual word processing in school-age children with a history of specific language impairment: an event-related potential study.

Authors:  Natalya Kaganovich; Jennifer Schumaker; Courtney Rowland
Journal:  J Neurodev Disord       Date:  2016-09-05       Impact factor: 4.025

6.  Learning Spoken Words via the Ears and Eyes: Evidence from 30-Month-Old Children.

Authors:  Mélanie Havy; Pascal Zesiger
Journal:  Front Psychol       Date:  2017-12-08

Review 7.  Development of the Mechanisms Underlying Audiovisual Speech Perception Benefit.

Authors:  Kaylah Lalonde; Lynne A Werner
Journal:  Brain Sci       Date:  2021-01-05
  7 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.