Literature DB >> 25421408

The self-advantage in visual speech processing enhances audiovisual speech recognition in noise.

Nancy Tye-Murray1, Brent P Spehar, Joel Myerson, Sandra Hale, Mitchell S Sommers.   

Abstract

Individuals lip read themselves more accurately than they lip read others when only the visual speech signal is available (Tye-Murray et al., Psychonomic Bulletin & Review, 20, 115-119, 2013). This self-advantage for vision-only speech recognition is consistent with the common-coding hypothesis (Prinz, European Journal of Cognitive Psychology, 9, 129-154, 1997), which posits (1) that observing an action activates the same motor plan representation as actually performing that action and (2) that observing one's own actions activates motor plan representations more than the others' actions because of greater congruity between percepts and corresponding motor plans. The present study extends this line of research to audiovisual speech recognition by examining whether there is a self-advantage when the visual signal is added to the auditory signal under poor listening conditions. Participants were assigned to sub-groups for round-robin testing in which each participant was paired with every member of their subgroup, including themselves, serving as both talker and listener/observer. On average, the benefit participants obtained from the visual signal when they were the talker was greater than when the talker was someone else and also was greater than the benefit others obtained from observing as well as listening to them. Moreover, the self-advantage in audiovisual speech recognition was significant after statistically controlling for individual differences in both participants' ability to benefit from a visual speech signal and the extent to which their own visual speech signal benefited others. These findings are consistent with our previous finding of a self-advantage in lip reading and with the hypothesis of a common code for action perception and motor plan representation.

Entities:  

Mesh:

Year:  2015        PMID: 25421408      PMCID: PMC4442762          DOI: 10.3758/s13423-014-0774-3

Source DB:  PubMed          Journal:  Psychon Bull Rev        ISSN: 1069-9384


  17 in total

Review 1.  The Theory of Event Coding (TEC): a framework for perception and action planning.

Authors:  B Hommel; J Müsseler; G Aschersleben; W Prinz
Journal:  Behav Brain Sci       Date:  2001-10       Impact factor: 12.579

2.  Listening to speech activates motor areas involved in speech production.

Authors:  Stephen M Wilson; Ayşe Pinar Saygin; Martin I Sereno; Marco Iacoboni
Journal:  Nat Neurosci       Date:  2004-06-06       Impact factor: 24.884

3.  Hearing lips and seeing voices.

Authors:  H McGurk; J MacDonald
Journal:  Nature       Date:  1976 Dec 23-30       Impact factor: 49.962

4.  Perceptual scaling of voice identity: common dimensions for different vowels and speakers.

Authors:  Oliver Baumann; Pascal Belin
Journal:  Psychol Res       Date:  2008-11-26

5.  Correlates of psychological dimensions in talker similarity.

Authors:  B E Walden; A A Montgomery; G J Gibeily; R A Prosek; D M Schwartz
Journal:  J Speech Hear Res       Date:  1978-06

6.  Obligatory Broca's area modulation associated with passive speech perception.

Authors:  Travis H Turner; Julius Fridriksson; Julie Baker; David Eoute; Leonardo Bonilha; Christopher Rorden
Journal:  Neuroreport       Date:  2009-03-25       Impact factor: 1.837

7.  The English Lexicon Project.

Authors:  David A Balota; Melvin J Yap; Michael J Cortese; Keith A Hutchison; Brett Kessler; Bjorn Loftis; James H Neely; Douglas L Nelson; Greg B Simpson; Rebecca Treiman
Journal:  Behav Res Methods       Date:  2007-08

8.  Audiovisual integration and lipreading abilities of older adults with normal and impaired hearing.

Authors:  Nancy Tye-Murray; Mitchell S Sommers; Brent Spehar
Journal:  Ear Hear       Date:  2007-09       Impact factor: 3.570

9.  Reading your own lips: common-coding theory and visual speech perception.

Authors:  Nancy Tye-Murray; Brent P Spehar; Joel Myerson; Sandra Hale; Mitchell S Sommers
Journal:  Psychon Bull Rev       Date:  2013-02

10.  Talker variability in audio-visual speech perception.

Authors:  Shannon L M Heald; Howard C Nusbaum
Journal:  Front Psychol       Date:  2014-07-16
View more
  4 in total

Review 1.  Prediction and constraint in audiovisual speech perception.

Authors:  Jonathan E Peelle; Mitchell S Sommers
Journal:  Cortex       Date:  2015-03-20       Impact factor: 4.027

2.  Happy you, happy me: expressive changes on a stranger's voice recruit faster implicit processes than self-produced expressions.

Authors:  Laura Rachman; Stéphanie Dubal; Jean-Julien Aucouturier
Journal:  Soc Cogn Affect Neurosci       Date:  2019-05-31       Impact factor: 3.436

3.  Increased Connectivity among Sensory and Motor Regions during Visual and Audiovisual Speech Perception.

Authors:  Jonathan E Peelle; Brent Spehar; Michael S Jones; Sarah McConkey; Joel Myerson; Sandra Hale; Mitchell S Sommers; Nancy Tye-Murray
Journal:  J Neurosci       Date:  2021-11-23       Impact factor: 6.709

4.  The own-voice benefit for word recognition in early bilinguals.

Authors:  Sarah Cheung; Molly Babel
Journal:  Front Psychol       Date:  2022-09-02
  4 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.