Literature DB >> 20329858

A reanalysis of McGurk data suggests that audiovisual fusion in speech perception is subject-dependent.

Jean-Luc Schwartz1.   

Abstract

Audiovisual perception of conflicting stimuli displays a large level of intersubject variability, generally larger than pure auditory or visual data. However, it is not clear whether this actually reflects differences in integration per se or just the consequence of slight differences in unisensory perception. It is argued that the debate has been blurred by methodological problems in the analysis of experimental data, particularly when using the fuzzy-logical model of perception (FLMP) [Massaro, D. W. (1987). Speech Perception by Ear and Eye: A Paradigm for Psychological Inquiry (Laurence Erlbaum Associates, London)] shown to display overfitting abilities with McGurk stimuli [Schwartz, J. L. (2006). J. Acoust. Soc. Am. 120, 1795-1798]. A large corpus of McGurk data is reanalyzed, using a methodology based on (1) comparison of FLMP and a variant with subject-dependent weights of the auditory and visual inputs in the fusion process, weighted FLMP (WFLMP); (2) use of a Bayesian selection model criterion instead of a root mean square error fit in model assessment; and (3) systematic exploration of the number of useful parameters in the models to compare, attempting to discard poorly explicative parameters. It is shown that WFLMP performs significantly better than FLMP, suggesting that audiovisual fusion is indeed subject-dependent, some subjects being more "auditory," and others more "visual." Intersubject variability has important consequences for theoretical understanding of the fusion process, and re-education of hearing impaired people.

Entities:  

Mesh:

Year:  2010        PMID: 20329858     DOI: 10.1121/1.3293001

Source DB:  PubMed          Journal:  J Acoust Soc Am        ISSN: 0001-4966            Impact factor:   1.840


  18 in total

1.  Neural correlates of interindividual differences in children's audiovisual speech perception.

Authors:  Audrey R Nath; Eswen E Fava; Michael S Beauchamp
Journal:  J Neurosci       Date:  2011-09-28       Impact factor: 6.167

2.  Cross-modal effects in speech perception.

Authors:  Megan Keough; Donald Derrick; Bryan Gick
Journal:  Annu Rev Linguist       Date:  2018-08-01

3.  Neural evidence accounting for interindividual variability of the McGurk illusion.

Authors:  Antoine J Shahin
Journal:  Neurosci Lett       Date:  2019-06-07       Impact factor: 3.046

4.  Audiovisual speech perception: A new approach and implications for clinical populations.

Authors:  Julia Irwin; Lori DiBlasi
Journal:  Lang Linguist Compass       Date:  2017-03-26

Review 5.  Multisensory Integration in Cochlear Implant Recipients.

Authors:  Ryan A Stevenson; Sterling W Sheffield; Iliza M Butera; René H Gifford; Mark T Wallace
Journal:  Ear Hear       Date:  2017 Sep/Oct       Impact factor: 3.570

6.  The noisy encoding of disparity model of the McGurk effect.

Authors:  John F Magnotti; Michael S Beauchamp
Journal:  Psychon Bull Rev       Date:  2015-06

7.  Cue integration in categorical tasks: insights from audio-visual speech perception.

Authors:  Vikranth Rao Bejjanki; Meghan Clayards; David C Knill; Richard N Aslin
Journal:  PLoS One       Date:  2011-05-26       Impact factor: 3.240

8.  Audiovisual segregation in cochlear implant users.

Authors:  Simon Landry; Benoit A Bacon; Jacqueline Leybaert; Jean-Pierre Gagné; François Champoux
Journal:  PLoS One       Date:  2012-03-12       Impact factor: 3.240

9.  Enhanced audiovisual integration with aging in speech perception: a heightened McGurk effect in older adults.

Authors:  Kaoru Sekiyama; Takahiro Soshi; Shinichi Sakamoto
Journal:  Front Psychol       Date:  2014-04-14

10.  What is the McGurk effect?

Authors:  Kaisa Tiippana
Journal:  Front Psychol       Date:  2014-07-10
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.