Literature DB >> 23955059

Experience with a talker can transfer across modalities to facilitate lipreading.

Kauyumari Sanchez1, James W Dias, Lawrence D Rosenblum.   

Abstract

Rosenblum, Miller, and Sanchez (Psychological Science, 18, 392-396, 2007) found that subjects first trained to lip-read a particular talker were then better able to perceive the auditory speech of that same talker, as compared with that of a novel talker. This suggests that the talker experience a perceiver gains in one sensory modality can be transferred to another modality to make that speech easier to perceive. An experiment was conducted to examine whether this cross-sensory transfer of talker experience could occur (1) from auditory to lip-read speech, (2) with subjects not screened for adequate lipreading skill, (3) when both a familiar and an unfamiliar talker are presented during lipreading, and (4) for both old (presentation set) and new words. Subjects were first asked to identify a set of words from a talker. They were then asked to perform a lipreading task from two faces, one of which was of the same talker they heard in the first phase of the experiment. Results revealed that subjects who lip-read from the same talker they had heard performed better than those who lip-read a different talker, regardless of whether the words were old or new. These results add further evidence that learning of amodal talker information can facilitate speech perception across modalities and also suggest that this information is not restricted to previously heard words.

Entities:  

Mesh:

Year:  2013        PMID: 23955059      PMCID: PMC3810281          DOI: 10.3758/s13414-013-0534-x

Source DB:  PubMed          Journal:  Atten Percept Psychophys        ISSN: 1943-3921            Impact factor:   2.199


  33 in total

1.  The marriage of perception and memory: creating two-way illusions with words and voices.

Authors:  S D Goldinger; H M Kleider; E Shelley
Journal:  Mem Cognit       Date:  1999-03

2.  Learning to recognize talkers from natural, sinewave, and reversed speech samples.

Authors:  Sonya M Sheffert; David B Pisoni; Jennifer M Fellowes; Robert E Remez
Journal:  J Exp Psychol Hum Percept Perform       Date:  2002-12       Impact factor: 3.332

3.  Cross-modal source information and spoken word recognition.

Authors:  Lorin Lachs; David B Pisoni
Journal:  J Exp Psychol Hum Percept Perform       Date:  2004-04       Impact factor: 3.332

4.  Hearing lips and seeing voices.

Authors:  H McGurk; J MacDonald
Journal:  Nature       Date:  1976 Dec 23-30       Impact factor: 49.962

5.  Hearing a face: cross-modal speaker matching using isolated visible speech.

Authors:  Lawrence D Rosenblum; Nicolas M Smith; Sarah M Nichols; Steven Hale; Joanne Lee
Journal:  Percept Psychophys       Date:  2006-01

6.  Crossmodal Source Identification in Speech Perception.

Authors:  Lorin Lachs; David B Pisoni
Journal:  Ecol Psychol       Date:  2004

7.  Talker-specific learning in speech perception.

Authors:  L C Nygaard; D B Pisoni
Journal:  Percept Psychophys       Date:  1998-04

8.  Recognizing prosody across modalities, face areas and speakers: examining perceivers' sensitivity to variable realizations of visual prosody.

Authors:  Erin Cvejic; Jeesun Kim; Chris Davis
Journal:  Cognition       Date:  2011-12-21

9.  Visual speech information for face recognition.

Authors:  Lawrence D Rosenblum; Deborah A Yakel; Naser Baseer; Anjani Panchal; Brynn C Nodarse; Ryan P Niehus
Journal:  Percept Psychophys       Date:  2002-02

10.  Lip-read me now, hear me better later: cross-modal transfer of talker-familiarity effects.

Authors:  Lawrence D Rosenblum; Rachel M Miller; Kauyumari Sanchez
Journal:  Psychol Sci       Date:  2007-05
View more
  2 in total

1.  Visibility of speech articulation enhances auditory phonetic convergence.

Authors:  James W Dias; Lawrence D Rosenblum
Journal:  Atten Percept Psychophys       Date:  2016-01       Impact factor: 2.199

2.  Perceptual Doping: An Audiovisual Facilitation Effect on Auditory Speech Processing, From Phonetic Feature Extraction to Sentence Identification in Noise.

Authors:  Shahram Moradi; Björn Lidestam; Elaine Hoi Ning Ng; Henrik Danielsson; Jerker Rönnberg
Journal:  Ear Hear       Date:  2019 Mar/Apr       Impact factor: 3.570

  2 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.