Literature DB >> 33254540

McGurk effect and audiovisual speech perception in students with learning disabilities exposed to online teaching during the COVID-19 pandemic.

Elena Kkese1.   

Abstract

Entities:  

Mesh:

Year:  2020        PMID: 33254540      PMCID: PMC7467019          DOI: 10.1016/j.mehy.2020.110233

Source DB:  PubMed          Journal:  Med Hypotheses        ISSN: 0306-9877            Impact factor:   1.538


× No keyword cloud information.
Speech perception is primarily considered as an auditory process. In face-to-face interaction, though, speech perception involves the integration of auditory (sounds) and visual (lip and face movements) information at some stage in the process. This integration occurs before phonetic evaluation [8] or at a later stage suggesting that the acoustic and visual signals are evaluated separately and then integrated [2]. The integration of acoustic and visual signals could give rise to the McGurk effect [3]. In this effect, audiovisual speech information integrates to the extent visual information influences what the hearers report listening [5]. The McGurk effect has been investigated in children and adults with normal hearing [7] but less often among children and adults with learning disabilities (LD) [1]. The question that arises is whether young adults with LD attending higher education could integrate auditory and visual information for speech perception in an online classroom context. These students typically face difficulties in basic auditory perception, attention and memory that may affect more complex cognitive processing. In traditional face-to-face classrooms, students with LD encounter several speech perception difficulties due to noisy open-classrooms and distance from the lecturer. On the other hand, online teaching may provide a more suitable alternative since it incorporates the use of audio-visual information. Students could attend a lecture away from the noisy classroom background focusing on the lecturer’s face and voice. We hypothesise that via online teaching, lecturers’ hyper-articulated speech could lead to clearer speech perception marked with exaggerated articulatory movements that facilitate visual perception. With the use of computer-based material such as online sessions and video streaming, we assume that students’ engagement increases while they take control over the pace of learning and, as a result, learn more effectively since they could review sessions repeatedly. Online teaching may be more beneficial since even though numerous computer-aided language learning systems (CALL) are available, the feedback that these provide to students stem from a speech processing software and, as a result, are very different to a human speaker [6], [4].

Funding

There has been no financial support for this work.

Declaration of Competing Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
  4 in total

Review 1.  Lipreading and audio-visual speech perception.

Authors:  Q Summerfield
Journal:  Philos Trans R Soc Lond B Biol Sci       Date:  1992-01-29       Impact factor: 6.237

2.  Integration of heard and seen speech: a factor in learning disabilities in children.

Authors:  Erin A Hayes; Kaisa Tiippana; Trent G Nicol; Mikko Sams; Nina Kraus
Journal:  Neurosci Lett       Date:  2003-11-06       Impact factor: 3.046

3.  Hearing lips and seeing voices.

Authors:  H McGurk; J MacDonald
Journal:  Nature       Date:  1976 Dec 23-30       Impact factor: 49.962

4.  Enhanced audiovisual integration with aging in speech perception: a heightened McGurk effect in older adults.

Authors:  Kaoru Sekiyama; Takahiro Soshi; Shinichi Sakamoto
Journal:  Front Psychol       Date:  2014-04-14
  4 in total
  2 in total

1.  Exploration on the Application Path of College English MOOCS Teaching under the Background of Internet of Things.

Authors:  Daoping Xu
Journal:  Comput Intell Neurosci       Date:  2022-05-21

2.  The Online Teaching Mode of College English in the Context of Gaussian Variant Genetic Algorithm.

Authors:  Shengfen Wang; Wei Hu; Yuan Lei
Journal:  Comput Intell Neurosci       Date:  2021-12-20
  2 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.