Literature DB >> 27562763

McGurk stimuli for the investigation of multisensory integration in cochlear implant users: The Oldenburg Audio Visual Speech Stimuli (OLAVS).

Maren Stropahl1, Sebastian Schellhardt2, Stefan Debener3,4.   

Abstract

The concurrent presentation of different auditory and visual syllables may result in the perception of a third syllable, reflecting an illusory fusion of visual and auditory information. This well-known McGurk effect is frequently used for the study of audio-visual integration. Recently, it was shown that the McGurk effect is strongly stimulus-dependent, which complicates comparisons across perceivers and inferences across studies. To overcome this limitation, we developed the freely available Oldenburg audio-visual speech stimuli (OLAVS), consisting of 8 different talkers and 12 different syllable combinations. The quality of the OLAVS set was evaluated with 24 normal-hearing subjects. All 96 stimuli were characterized based on their stimulus disparity, which was obtained from a probabilistic model (cf. Magnotti & Beauchamp, 2015). Moreover, the McGurk effect was studied in eight adult cochlear implant (CI) users. By applying the individual, stimulus-independent parameters of the probabilistic model, the predicted effect of stronger audio-visual integration in CI users could be confirmed, demonstrating the validity of the new stimulus material.

Keywords:  Audio-visual integration; Cochlear implants; McGurk illusion

Mesh:

Year:  2017        PMID: 27562763     DOI: 10.3758/s13423-016-1148-9

Source DB:  PubMed          Journal:  Psychon Bull Rev        ISSN: 1069-9384


  26 in total

1.  Visual activation of auditory cortex reflects maladaptive plasticity in cochlear implant users.

Authors:  Pascale Sandmann; Norbert Dillier; Tom Eichele; Martin Meyer; Andrea Kegel; Roberto Domingo Pascual-Marqui; Valentine Leslie Marcar; Lutz Jäncke; Stefan Debener
Journal:  Brain       Date:  2012-01-09       Impact factor: 13.501

2.  Hearing lips and seeing voices.

Authors:  H McGurk; J MacDonald
Journal:  Nature       Date:  1976 Dec 23-30       Impact factor: 49.962

3.  Visual speech speeds up the neural processing of auditory speech.

Authors:  Virginie van Wassenhove; Ken W Grant; David Poeppel
Journal:  Proc Natl Acad Sci U S A       Date:  2005-01-12       Impact factor: 11.205

4.  Evidence that cochlear-implanted deaf patients are better multisensory integrators.

Authors:  J Rouger; S Lagleyre; B Fraysse; S Deneve; O Deguine; P Barone
Journal:  Proc Natl Acad Sci U S A       Date:  2007-04-02       Impact factor: 11.205

5.  Auditory-visual speech perception in normal-hearing and cochlear-implant listeners.

Authors:  Sheetal Desai; Ginger Stickney; Fan-Gang Zeng
Journal:  J Acoust Soc Am       Date:  2008-01       Impact factor: 1.840

6.  Similar frequency of the McGurk effect in large samples of native Mandarin Chinese and American English speakers.

Authors:  John F Magnotti; Debshila Basu Mallick; Guo Feng; Bin Zhou; Wen Zhou; Michael S Beauchamp
Journal:  Exp Brain Res       Date:  2015-06-04       Impact factor: 1.972

7.  Individual differences in the multisensory temporal binding window predict susceptibility to audiovisual illusions.

Authors:  Ryan A Stevenson; Raquel K Zemtsov; Mark T Wallace
Journal:  J Exp Psychol Hum Percept Perform       Date:  2012-03-05       Impact factor: 3.332

8.  Auditory-visual fusion in speech perception in children with cochlear implants.

Authors:  Efrat A Schorr; Nathan A Fox; Virginie van Wassenhove; Eric I Knudsen
Journal:  Proc Natl Acad Sci U S A       Date:  2005-12-08       Impact factor: 11.205

9.  Audiovisual fusion and cochlear implant proficiency.

Authors:  Corinne Tremblay; François Champoux; Franco Lepore; Hugo Théoret
Journal:  Restor Neurol Neurosci       Date:  2010       Impact factor: 2.406

10.  The noisy encoding of disparity model of the McGurk effect.

Authors:  John F Magnotti; Michael S Beauchamp
Journal:  Psychon Bull Rev       Date:  2015-06
View more
  8 in total

Review 1.  Multisensory Integration in Cochlear Implant Recipients.

Authors:  Ryan A Stevenson; Sterling W Sheffield; Iliza M Butera; René H Gifford; Mark T Wallace
Journal:  Ear Hear       Date:  2017 Sep/Oct       Impact factor: 3.570

2.  Published estimates of group differences in multisensory integration are inflated.

Authors:  John F Magnotti; Michael S Beauchamp
Journal:  PLoS One       Date:  2018-09-19       Impact factor: 3.240

3.  A causal inference explanation for enhancement of multisensory integration by co-articulation.

Authors:  John F Magnotti; Kristen B Smith; Marcelo Salinas; Jacqunae Mays; Lin L Zhu; Michael S Beauchamp
Journal:  Sci Rep       Date:  2018-12-21       Impact factor: 4.379

4.  Disentangling early versus late audiovisual integration in adult ADHD: a combined behavioural and resting-state connectivity study.

Authors:  Marcel Schulze; Behrem Aslan; Tony Stöcker; Rüdiger Stirnberg; Silke Lux; Alexandra Philipsen
Journal:  J Psychiatry Neurosci       Date:  2021-09-01       Impact factor: 6.186

5.  Functional localization of audiovisual speech using near infrared spectroscopy.

Authors:  Iliza M Butera; Eric D Larson; Andrea J DeFreese; Adrian Kc Lee; René H Gifford; Mark T Wallace
Journal:  Brain Topogr       Date:  2022-07-12       Impact factor: 4.275

6.  When eyes beat lips: speaker gaze affects audiovisual integration in the McGurk illusion.

Authors:  Basil Wahn; Laura Schmitz; Alan Kingstone; Anne Böckler-Raettig
Journal:  Psychol Res       Date:  2021-12-02

7.  Auditory cross-modal reorganization in cochlear implant users indicates audio-visual integration.

Authors:  Maren Stropahl; Stefan Debener
Journal:  Neuroimage Clin       Date:  2017-09-04       Impact factor: 4.881

8.  Multimodal and Spectral Degradation Effects on Speech and Emotion Recognition in Adult Listeners.

Authors:  Chantel Ritter; Tara Vongpaisal
Journal:  Trends Hear       Date:  2018 Jan-Dec       Impact factor: 3.293

  8 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.