Literature DB >> 35316072

Lipreading: A Review of Its Continuing Importance for Speech Recognition With an Acquired Hearing Loss and Possibilities for Effective Training.

Lynne E Bernstein1, Nicole Jordan1, Edward T Auer1, Silvio P Eberhardt1.   

Abstract

PURPOSE: The goal of this review article is to reinvigorate interest in lipreading and lipreading training for adults with acquired hearing loss. Most adults benefit from being able to see the talker when speech is degraded; however, the effect size is related to their lipreading ability, which is typically poor in adults who have experienced normal hearing through most of their lives. Lipreading training has been viewed as a possible avenue for rehabilitation of adults with an acquired hearing loss, but most training approaches have not been particularly successful. Here, we describe lipreading and theoretically motivated approaches to its training, as well as examples of successful training paradigms. We discuss some extensions to auditory-only (AO) and audiovisual (AV) speech recognition.
METHOD: Visual speech perception and word recognition are described. Traditional and contemporary views of training and perceptual learning are outlined. We focus on the roles of external and internal feedback and the training task in perceptual learning, and we describe results of lipreading training experiments.
RESULTS: Lipreading is commonly characterized as limited to viseme perception. However, evidence demonstrates subvisemic perception of visual phonetic information. Lipreading words also relies on lexical constraints, not unlike auditory spoken word recognition. Lipreading has been shown to be difficult to improve through training, but under specific feedback and task conditions, training can be successful, and learning can generalize to untrained materials, including AV sentence stimuli in noise. The results on lipreading have implications for AO and AV training and for use of acoustically processed speech in face-to-face communication.
CONCLUSION: Given its importance for speech recognition with a hearing loss, we suggest that the research and clinical communities integrate lipreading in their efforts to improve speech recognition in adults with acquired hearing loss.

Entities:  

Mesh:

Year:  2022        PMID: 35316072      PMCID: PMC9524756          DOI: 10.1044/2021_AJA-21-00112

Source DB:  PubMed          Journal:  Am J Audiol        ISSN: 1059-0889            Impact factor:   1.636


  126 in total

1.  Towards a functional neuroanatomy of speech perception.

Authors: 
Journal:  Trends Cogn Sci       Date:  2000-04       Impact factor: 20.229

2.  Hearing lips and seeing voices.

Authors:  H McGurk; J MacDonald
Journal:  Nature       Date:  1976 Dec 23-30       Impact factor: 49.962

3.  Lexical information drives perceptual learning of distorted speech: evidence from the comprehension of noise-vocoded sentences.

Authors:  Matthew H Davis; Ingrid S Johnsrude; Alexis Hervais-Adelman; Karen Taylor; Carolyn McGettigan
Journal:  J Exp Psychol Gen       Date:  2005-05

4.  Development and efficacy of a frequent-word auditory training protocol for older adults with impaired hearing.

Authors:  Larry E Humes; Matthew H Burk; Lauren E Strauser; Dana L Kinney
Journal:  Ear Hear       Date:  2009-10       Impact factor: 3.570

5.  Effects of long-term training on aided speech-recognition performance in noise in older adults.

Authors:  Matthew H Burk; Larry E Humes
Journal:  J Speech Lang Hear Res       Date:  2008-06       Impact factor: 2.297

6.  Speechreading sentences with single-channel vibrotactile presentation of voice fundamental frequency.

Authors:  S P Eberhardt; L E Bernstein; M E Demorest; M H Goldstein
Journal:  J Acoust Soc Am       Date:  1990-09       Impact factor: 1.840

7.  Categorical and noncategorical modes of speech perception along the voicing continuum.

Authors:  D B Pisoni; J H Lazarus
Journal:  J Acoust Soc Am       Date:  1974-02       Impact factor: 1.840

8.  Benefit from non-linear frequency compression hearing aids in a clinical setting: the effects of duration of experience and severity of high-frequency hearing loss.

Authors:  Kathryn Hopkins; Mumtaz Khanom; Ann-Marie Dickinson; Kevin J Munro
Journal:  Int J Audiol       Date:  2014-04       Impact factor: 2.117

Review 9.  Prediction and constraint in audiovisual speech perception.

Authors:  Jonathan E Peelle; Mitchell S Sommers
Journal:  Cortex       Date:  2015-03-20       Impact factor: 4.027

10.  Predictive top-down integration of prior knowledge during speech perception.

Authors:  Ediz Sohoglu; Jonathan E Peelle; Robert P Carlyon; Matthew H Davis
Journal:  J Neurosci       Date:  2012-06-20       Impact factor: 6.167

View more
  1 in total

1.  During Lipreading Training With Sentence Stimuli, Feedback Controls Learning and Generalization to Audiovisual Speech in Noise.

Authors:  Lynne E Bernstein; Edward T Auer; Silvio P Eberhardt
Journal:  Am J Audiol       Date:  2021-12-29       Impact factor: 1.636

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.