Literature DB >> 25716790

Rapid, generalized adaptation to asynchronous audiovisual speech.

Erik Van der Burg1, Patrick T Goodbourn2.   

Abstract

The brain is adaptive. The speed of propagation through air, and of low-level sensory processing, differs markedly between auditory and visual stimuli; yet the brain can adapt to compensate for the resulting cross-modal delays. Studies investigating temporal recalibration to audiovisual speech have used prolonged adaptation procedures, suggesting that adaptation is sluggish. Here, we show that adaptation to asynchronous audiovisual speech occurs rapidly. Participants viewed a brief clip of an actor pronouncing a single syllable. The voice was either advanced or delayed relative to the corresponding lip movements, and participants were asked to make a synchrony judgement. Although we did not use an explicit adaptation procedure, we demonstrate rapid recalibration based on a single audiovisual event. We find that the point of subjective simultaneity on each trial is highly contingent upon the modality order of the preceding trial. We find compelling evidence that rapid recalibration generalizes across different stimuli, and different actors. Finally, we demonstrate that rapid recalibration occurs even when auditory and visual events clearly belong to different actors. These results suggest that rapid temporal recalibration to audiovisual speech is primarily mediated by basic temporal factors, rather than higher-order factors such as perceived simultaneity and source identity.
© 2015 The Author(s) Published by the Royal Society. All rights reserved.

Entities:  

Keywords:  audiovisual speech; cross-modal adaptation; multisensory integration; synchrony judgement; temporal recalibration

Mesh:

Year:  2015        PMID: 25716790      PMCID: PMC4375877          DOI: 10.1098/rspb.2014.3083

Source DB:  PubMed          Journal:  Proc Biol Sci        ISSN: 0962-8452            Impact factor:   5.349


  43 in total

1.  Synchronizing to real events: subjective audiovisual alignment scales with perceived auditory depth and speed of sound.

Authors:  David Alais; Simon Carlile
Journal:  Proc Natl Acad Sci U S A       Date:  2005-01-24       Impact factor: 11.205

Review 2.  The processing of audio-visual speech: empirical and neural bases.

Authors:  Ruth Campbell
Journal:  Philos Trans R Soc Lond B Biol Sci       Date:  2008-03-12       Impact factor: 6.237

3.  The effect of exposure to asynchronous audio, visual, and tactile stimulus combinations on the perception of simultaneity.

Authors:  Vanessa Harrar; Laurence R Harris
Journal:  Exp Brain Res       Date:  2008-01-09       Impact factor: 1.972

4.  Multisensory simultaneity recalibration: storage of the aftereffect in the absence of counterevidence.

Authors:  Tonja-Katrin Machulla; Massimiliano Di Luca; Eva Froehlich; Marc O Ernst
Journal:  Exp Brain Res       Date:  2011-12-30       Impact factor: 1.972

5.  Audiovisual events capture attention: evidence from temporal order judgments.

Authors:  Erik Van der Burg; Christian N L Olivers; Adelbert W Bronkhorst; Jan Theeuwes
Journal:  J Vis       Date:  2008-05-07       Impact factor: 2.240

6.  Audiovisual time perception is spatially specific.

Authors:  James Heron; Neil W Roach; James V M Hanson; Paul V McGraw; David Whitaker
Journal:  Exp Brain Res       Date:  2012-02-25       Impact factor: 1.972

7.  Sound speeds vision through preparation, not integration.

Authors:  Sander A Los; Erik Van der Burg
Journal:  J Exp Psychol Hum Percept Perform       Date:  2013-03-11       Impact factor: 3.332

8.  Intersensory facilitation of reaction time: energy summation or preparation enhancement?

Authors:  R S Nickerson
Journal:  Psychol Rev       Date:  1973-11       Impact factor: 8.934

9.  Visual recalibration and selective adaptation in auditory-visual speech perception: Contrasting build-up courses.

Authors:  Jean Vroomen; Sabine van Linden; Béatrice de Gelder; Paul Bertelson
Journal:  Neuropsychologia       Date:  2006-03-10       Impact factor: 3.139

10.  Audio-Visual Temporal Recalibration Can be Constrained by Content Cues Regardless of Spatial Overlap.

Authors:  Warrick Roseboom; Takahiro Kawabe; Shin'ya Nishida
Journal:  Front Psychol       Date:  2013-04-24
View more
  17 in total

1.  Long-term music training modulates the recalibration of audiovisual simultaneity.

Authors:  Crescent Jicol; Michael J Proulx; Frank E Pollick; Karin Petrini
Journal:  Exp Brain Res       Date:  2018-04-23       Impact factor: 1.972

2.  Task-dependent audiovisual temporal sensitivity is not affected by stimulus intensity levels.

Authors:  Alexandra N Scurry; Zachary Lovelady; Fang Jiang
Journal:  Vision Res       Date:  2021-05-28       Impact factor: 1.886

3.  No rapid audiovisual recalibration in adults on the autism spectrum.

Authors:  Marco Turi; Themelis Karaminis; Elizabeth Pellicano; David Burr
Journal:  Sci Rep       Date:  2016-02-22       Impact factor: 4.379

4.  Audiovisual Simultaneity Judgment and Rapid Recalibration throughout the Lifespan.

Authors:  Jean-Paul Noel; Matthew De Niear; Erik Van der Burg; Mark T Wallace
Journal:  PLoS One       Date:  2016-08-23       Impact factor: 3.240

5.  Increases in the autistic trait of attention to detail are associated with decreased multisensory temporal adaptation.

Authors:  Ryan A Stevenson; Jennifer K Toulmin; Ariana Youm; Richard M A Besney; Samantha E Schulz; Morgan D Barense; Susanne Ferber
Journal:  Sci Rep       Date:  2017-10-30       Impact factor: 4.379

6.  Voluntary and Involuntary Movements Widen the Window of Subjective Simultaneity.

Authors:  B Ezgi Arikan; Bianca M van Kemenade; Benjamin Straube; Laurence R Harris; Tilo Kircher
Journal:  Iperception       Date:  2017-07-07

7.  Shifts in Audiovisual Processing in Healthy Aging.

Authors:  Sarah H Baum; Ryan Stevenson
Journal:  Curr Behav Neurosci Rep       Date:  2017-08-10

8.  Audiovisual temporal recalibration occurs independently at two different time scales.

Authors:  Erik Van der Burg; David Alais; John Cass
Journal:  Sci Rep       Date:  2015-10-12       Impact factor: 4.379

9.  Phonetic recalibration of speech by text.

Authors:  Mirjam Keetels; Lemmy Schakel; Milene Bonte; Jean Vroomen
Journal:  Atten Percept Psychophys       Date:  2016-04       Impact factor: 2.199

10.  Temporal causal inference with stochastic audiovisual sequences.

Authors:  Shannon M Locke; Michael S Landy
Journal:  PLoS One       Date:  2017-09-08       Impact factor: 3.240

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.