Michael Pilling1. 1. MRC Institute of Hearing Research, Nottingham, United Kingdom. mpilling@brookes.ac.uk
Abstract
PURPOSE: It has recently been reported (e.g., V. van Wassenhove, K. W. Grant, & D. Poeppel, 2005) that audiovisual (AV) presented speech is associated with an N1/P2 auditory event-related potential (ERP) response that is lower in peak amplitude compared with the responses associated with auditory only (AO) speech. This effect was replicated. Further comparisons were made between ERP responses to AV speech in which the visual and auditory components were in or out of synchrony, to test whether the effect is associated with the operation of integration mechanisms, as has been claimed, or occurs because of other factors such as attention. METHOD: ERPs were recorded from participants presented with recordings of unimodal or AV speech syllables in a detection task. RESULTS: Comparisons were made between AO and AV speech and between synchronous and asynchronous AV speech. Synchronous AV speech produced an N1/P2 with lower peak amplitudes than with AO speech, unaccounted for by linear superposition of visually evoked responses onto auditory-evoked responses. Asynchronous AV speech produced no amplitude reduction. CONCLUSION: The dependence of N1/P2 amplitude reduction on AV synchrony validates it as an electrophysiological marker of AV integration.
PURPOSE: It has recently been reported (e.g., V. van Wassenhove, K. W. Grant, & D. Poeppel, 2005) that audiovisual (AV) presented speech is associated with an N1/P2 auditory event-related potential (ERP) response that is lower in peak amplitude compared with the responses associated with auditory only (AO) speech. This effect was replicated. Further comparisons were made between ERP responses to AV speech in which the visual and auditory components were in or out of synchrony, to test whether the effect is associated with the operation of integration mechanisms, as has been claimed, or occurs because of other factors such as attention. METHOD: ERPs were recorded from participants presented with recordings of unimodal or AV speech syllables in a detection task. RESULTS: Comparisons were made between AO and AV speech and between synchronous and asynchronous AV speech. Synchronous AV speech produced an N1/P2 with lower peak amplitudes than with AO speech, unaccounted for by linear superposition of visually evoked responses onto auditory-evoked responses. Asynchronous AV speech produced no amplitude reduction. CONCLUSION: The dependence of N1/P2 amplitude reduction on AV synchrony validates it as an electrophysiological marker of AV integration.
Authors: Ariane E Rhone; Kirill V Nourski; Hiroyuki Oya; Hiroto Kawasaki; Matthew A Howard; Bob McMurray Journal: Lang Cogn Neurosci Date: 2015-10-19 Impact factor: 2.331
Authors: Ye Zhang; Diego Frassinelli; Jyrki Tuomainen; Jeremy I Skipper; Gabriella Vigliocco Journal: Proc Biol Sci Date: 2021-07-21 Impact factor: 5.349