Literature DB >> 21035795

Perception of intersensory synchrony in audiovisual speech: not that special.

Jean Vroomen1, Jeroen J Stekelenburg.   

Abstract

Perception of intersensory temporal order is particularly difficult for (continuous) audiovisual speech, as perceivers may find it difficult to notice substantial timing differences between speech sounds and lip movements. Here we tested whether this occurs because audiovisual speech is strongly paired ("unity assumption"). Participants made temporal order judgments (TOJ) and simultaneity judgments (SJ) about sine-wave speech (SWS) replicas of pseudowords and the corresponding video of the face. Listeners in speech and non-speech mode were equally sensitive judging audiovisual temporal order. Yet, using the McGurk effect, we could demonstrate that the sound was more likely integrated with lipread speech if heard as speech than non-speech. Judging temporal order in audiovisual speech is thus unaffected by whether the auditory and visual streams are paired. Conceivably, previously found differences between speech and non-speech stimuli are not due to the putative "special" nature of speech, but rather reflect low-level stimulus differences.
Copyright © 2010 Elsevier B.V. All rights reserved.

Entities:  

Mesh:

Year:  2010        PMID: 21035795     DOI: 10.1016/j.cognition.2010.10.002

Source DB:  PubMed          Journal:  Cognition        ISSN: 0010-0277


  27 in total

1.  Children with a history of SLI show reduced sensitivity to audiovisual temporal asynchrony: an ERP study.

Authors:  Natalya Kaganovich; Jennifer Schumaker; Laurence B Leonard; Dana Gustafson; Danielle Macias
Journal:  J Speech Lang Hear Res       Date:  2014-08       Impact factor: 2.297

2.  Sensitivity to Audiovisual Temporal Asynchrony in Children With a History of Specific Language Impairment and Their Peers With Typical Development: A Replication and Follow-Up Study.

Authors:  Natalya Kaganovich
Journal:  J Speech Lang Hear Res       Date:  2017-08-16       Impact factor: 2.297

3.  Phonetic matching of auditory and visual speech develops during childhood: evidence from sine-wave speech.

Authors:  Martijn Baart; Heather Bortfeld; Jean Vroomen
Journal:  J Exp Child Psychol       Date:  2014-09-23

4.  Stimulus intensity modulates multisensory temporal processing.

Authors:  Juliane Krueger Fister; Ryan A Stevenson; Aaron R Nidiffer; Zachary P Barnett; Mark T Wallace
Journal:  Neuropsychologia       Date:  2016-02-23       Impact factor: 3.139

5.  Audiovisual speech perception development at varying levels of perceptual processing.

Authors:  Kaylah Lalonde; Rachael Frush Holt
Journal:  J Acoust Soc Am       Date:  2016-04       Impact factor: 1.840

6.  Neurophysiology underlying influence of stimulus reliability on audiovisual integration.

Authors:  Hannah Shatzer; Stanley Shen; Jess R Kerlin; Mark A Pitt; Antoine J Shahin
Journal:  Eur J Neurosci       Date:  2018-02-09       Impact factor: 3.386

7.  Electrophysiological correlates of individual differences in perception of audiovisual temporal asynchrony.

Authors:  Natalya Kaganovich; Jennifer Schumaker
Journal:  Neuropsychologia       Date:  2016-04-16       Impact factor: 3.139

8.  Can you hear me yet? An intracranial investigation of speech and non-speech audiovisual interactions in human cortex.

Authors:  Ariane E Rhone; Kirill V Nourski; Hiroyuki Oya; Hiroto Kawasaki; Matthew A Howard; Bob McMurray
Journal:  Lang Cogn Neurosci       Date:  2015-10-19       Impact factor: 2.331

9.  Development of sensitivity to audiovisual temporal asynchrony during midchildhood.

Authors:  Natalya Kaganovich
Journal:  Dev Psychol       Date:  2016-02

10.  Degrading phonetic information affects matching of audiovisual speech in adults, but not in infants.

Authors:  Martijn Baart; Jean Vroomen; Kathleen Shaw; Heather Bortfeld
Journal:  Cognition       Date:  2013-10-18
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.